Sep 24 17:29:46 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 17:29:46 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 17:29:46 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 17:29:48 devstack cinder-volume[76719]: INFO dbcounter [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Registered counter for database cinder
Sep 24 17:29:48 devstack cinder-volume[76719]: DEBUG oslo_db.sqlalchemy.engines [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:29:48 devstack cinder-volume[76719]: DEBUG dbcounter [-] [76719] Writer thread running {{(pid=76719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 17:29:48 devstack cinder-volume[76719]: INFO cinder.rpc [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 24 17:29:48 devstack cinder-volume[76719]: INFO cinder.rpc [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 24 17:29:48 devstack cinder-volume[76719]: DEBUG oslo_db.sqlalchemy.engines [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:29:49 devstack cinder-volume[76719]: INFO cinder.volume.manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Determined volume DB was empty at startup.
Sep 24 17:29:49 devstack cinder-volume[76719]: DEBUG cinder.volume.manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76719) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 24 17:29:49 devstack cinder-volume[76719]: INFO cinder.volume.manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 24 17:29:49 devstack cinder-volume[76719]: WARNING stevedore.named [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 17:29:49 devstack cinder-volume[76719]: WARNING castellan.key_manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 17:29:49 devstack cinder-volume[76719]: WARNING cinder.keymgr.conf_key_mgr [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 17:29:49 devstack cinder-volume[76719]: DEBUG cinder.volume.drivers.lvm [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76719) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 24 17:29:49 devstack cinder-volume[76719]: DEBUG oslo_concurrency.processutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_concurrency.processutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] CMD "cinder-rtstool verify" returned: 0 in 1.123s {{(pid=76719) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_db.sqlalchemy.engines [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:29:50 devstack cinder-volume[76719]: INFO cinder.rpc [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 24 17:29:50 devstack cinder-volume[76719]: INFO cinder.rpc [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 24 17:29:50 devstack cinder-volume[76719]: WARNING stevedore.named [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 17:29:50 devstack cinder-volume[76719]: WARNING castellan.key_manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 17:29:50 devstack cinder-volume[76719]: INFO cinder.volume.manager [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_db.sqlalchemy.engines [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76719) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:29:50 devstack cinder-volume[76719]: INFO oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Starting 1 workers
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Started child 76866 {{(pid=76719) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Full set of CONF: {{(pid=76719) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] ******************************************************************************** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Configuration options gathered from: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] ================================================================================ {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] allow_availability_zone_fallback = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] allow_compression_on_image_upload = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] allowed_direct_url_schemes     = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] api_rate_limit                 = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] auth_strategy                  = keystone {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] az_cache_duration              = 3600 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_availability_zone      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_host                   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_name                   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_stats_polling_interval = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backup_api_class               = cinder.backup.api.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76866]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backup_name_template           = backup-%s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backup_use_same_host           = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backup_use_temp_snapshot       = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] chap_password                  = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] chap_username                  =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_internal_tenant_project_id = c36db0cb26864c979e777959cb939824 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_internal_tenant_user_id = f0b8098cb03d4a76b6266a423ec45163 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cloned_volume_same_az          = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cluster                        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] compression_format             = gzip {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] config_dir                     = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] config_source                  = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] control_exchange               = openstack {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] debug                          = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] default_availability_zone      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] default_group_type             = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] default_volume_type            = lvmdriver-1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_client_cert             = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_client_cert_key         = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_data_namespace          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_ssl_cert_path           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_ssl_cert_verify         = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] driver_use_ssl                 = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] enable_force_upload            = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] enable_new_services            = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] enable_unsupported_driver      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] enforce_multipath_for_image_xfer = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] filter_function                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_api_insecure            = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_api_servers             = ['http://192.168.122.72/image'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_api_ssl_compression     = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_ca_certificates_file    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_certfile                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_keyfile                 = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_num_retries             = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance_request_timeout         = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] goodness_function              = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] graceful_shutdown_timeout      = 5 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] group_api_class                = cinder.group.api.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] host                           = devstack {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_compress_on_upload       = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:50 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_conversion_address_space_limit = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_conversion_cpu_limit     = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_conversion_disable       = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_upload_use_cinder_backend = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_upload_use_internal_tenant = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_volume_cache_enabled     = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_volume_cache_max_count   = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] image_volume_cache_max_size_gb = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] init_host_max_objects_retrieval = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iscsi_iotype                   = fileio {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iscsi_target_flags             =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iscsi_write_cache              = on {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iser_helper                    = tgtadm {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iser_ip_address                = 192.168.122.72 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iser_port                      = 3260 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_color                      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_config_append              = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_dir                        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_file                       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_options                    = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_rotate_interval            = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_rotate_interval_type       = days {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] log_rotation_type              = none {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] max_age                        = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] max_logfile_count              = 30 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] max_logfile_size_mb            = 200 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] max_over_subscription_ratio    = 20.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] message_reap_interval          = 86400 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] message_ttl                    = 2592000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] migration_create_volume_timeout_secs = 300 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] monkey_patch                   = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] monkey_patch_modules           = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] my_ip                          = 192.168.122.72 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] no_snapshot_gb_quota           = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] num_iser_scan_tries            = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] num_shell_tries                = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] num_volume_device_scan_tries   = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] nvmeof_conn_info_version       = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] nvmet_ns_id                    = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] nvmet_port_id                  = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_max_limit                = 1000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_ext_list          = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_listen_port       = 8776 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_use_ssl           = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] osapi_volume_workers           = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] per_volume_size_limit          = -1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] periodic_fuzzy_delay           = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] periodic_interval              = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] public_endpoint                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] publish_errors                 = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_backup_gigabytes         = 1000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_backups                  = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_gigabytes                = 1000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_groups                   = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_snapshots                = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] quota_volumes                  = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] rate_limit_burst               = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] rate_limit_except_level        = CRITICAL {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] rate_limit_interval            = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] reinit_driver_count            = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] replication_device             = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] report_discard_supported       = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] report_interval                = 120 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] reservation_clean_interval     = 86400 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] reservation_expire             = 86400 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] reserved_image_namespaces      = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] reserved_percentage            = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] rpc_response_timeout           = 120 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] run_external_periodic_tasks    = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] scst_target_driver             = iscsi {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] scst_target_iqn_name           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_down_time              = 720 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] shell_completion               = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] snapshot_name_template         = snapshot-%s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] snapshot_same_host             = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] split_loggers                  = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] state_path                     = /opt/stack/data/cinder {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] storage_availability_zone      = nova {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] storage_protocol               = iSCSI {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] syslog_log_facility            = LOG_USER {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_helper                  = lioadm {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_ip_address              = 192.168.122.72 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_port                    = 3260 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_protocol                = iscsi {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] target_secondary_ip_addresses  = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] trace_flags                    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] transport_url                  = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] until_refresh                  = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_chap_auth                  = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_default_quota_class        = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_journal                    = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_json                       = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_multipath_for_image_xfer   = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_stderr                     = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] use_syslog                     = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] verify_glance_signatures       = enabled {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_api_class               = cinder.volume.api.API {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_backend_name            = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_clear                   = zero {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_clear_ionice            = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_clear_size              = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_copy_bps_limit          = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_dd_blocksize            = 1M {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_name_template           = volume-%s {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_service_inithost_offload = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volume_usage_audit_period      = month {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] watch_log_file                 = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] zoning_mode                    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_concurrency.disable_process_locking = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.admin_password = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.admin_token = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.admin_user  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_port   = 35357 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_protocol = https {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_section = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_type   = password {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_uri    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.auth_version = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.cache       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.certfile    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.identity_uri = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.include_service_catalog = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.insecure    = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.interface   = public {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.keyfile     = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_password =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcache_username =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.region_name = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.service_token_roles_required = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.service_type = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.backend                  = dogpile.cache.null {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.backend_argument         = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.backend_expiration_time  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.config_prefix            = cache.oslo {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.dead_timeout             = 60.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.debug_cache_backend      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.enable_retry_client      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.enable_socket_keepalive  = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.enabled                  = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.enforce_fips_mode        = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.expiration_time          = 600 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.hashclient_retry_attempts = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_dead_retry      = 300 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_password        = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_sasl_enabled    = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.memcache_username        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.proxies                  = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_db                 = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_password           = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_server             = localhost:6379 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_socket_timeout     = 1.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.redis_username           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.retry_attempts           = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.retry_delay              = 0.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.socket_keepalive_count   = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.socket_keepalive_idle    = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.socket_keepalive_interval = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.tls_allowed_ciphers      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.tls_cafile               = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.tls_certfile             = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.tls_enabled              = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cache.tls_keyfile              = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] coordination.backend_url       = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.asyncio_connection    = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.asyncio_slave_connection = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.backend               = sqlalchemy {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.connection            = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.connection_debug      = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.connection_parameters =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.connection_recycle_time = 3600 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.connection_trace      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.db_inc_retry_interval = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.db_max_retries        = 20 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.db_max_retry_interval = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.db_retry_interval     = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.max_overflow          = 50 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.max_pool_size         = 5 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.max_retries           = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.mysql_wsrep_sync_wait = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.pool_timeout          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.retry_interval        = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.slave_connection      = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.sqlite_synchronous    = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] database.use_db_reconnect      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.connection_string     = messaging:// {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76866]: INFO cinder.volume.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.enabled               = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.es_doc_type           = notification {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.es_scroll_size        = 10000 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.es_scroll_time        = 2m {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.filter_error_trace    = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.hmac_keys             = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.sentinel_service_name = mymaster {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.socket_timeout        = 0.1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.trace_requests        = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler.trace_sqlalchemy      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler_jaeger.process_tags   = {} {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler_jaeger.service_name_prefix = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] profiler_otlp.service_name_prefix = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.enforce_new_defaults = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:51 devstack cinder-volume[76719]: WARNING oslo_config.cfg [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.enforce_scope      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.policy_default_rule = default {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.group          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.helper_command = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] privsep_osbrick.user           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.group         = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.helper_command = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] cinder_sys_admin.user          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.auth_section      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.auth_type         = password {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.certfile          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.collect_timing    = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.insecure          = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.keyfile           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.send_service_user_token = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.split_loggers     = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] service_user.timeout           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.auth_section            = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.auth_type               = password {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.certfile                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.collect_timing          = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.insecure                = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.keyfile                 = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.split_loggers           = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] glance.timeout                 = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.backend_availability_zone = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.chap_password = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.chap_username =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_client_cert = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_client_cert_key = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_data_namespace = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.driver_use_ssl = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.extra_capabilities = {} {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.filter_function = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.goodness_function = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iscsi_target_flags =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iscsi_write_cache = on {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iser_port     = 3260 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.lvm_share_target = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.lvm_type      = auto {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.num_shell_tries = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.replication_device = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.report_discard_supported = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.reserved_percentage = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_helper = tgtadm {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_port   = 3260 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_protocol = iscsi {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.trace_flags   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.unique_fqdn_network = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.use_chap_auth = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_backend_name = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_clear  = zero {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_clear_ionice = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_clear_size = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_reports.file_event_handler = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_reports.log_dir           = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.backend_host       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.chap_password      = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.chap_username      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_client_cert = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.extra_capabilities = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.filter_function    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.goodness_function  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iser_helper        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iser_port          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.lvm_type           = auto {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.replication_device = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.report_discard_supported = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.reserved_percentage = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.scst_target_driver = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.storage_protocol   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_ip_address  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_port        = 3260 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.trace_flags        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_clear       = zero {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] lvmdriver-1.volumes_dir        = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_notifications.driver = [] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_notifications.retry = -1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] key_manager.fixed_key          = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.barbican_api_version  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.barbican_endpoint     = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.barbican_endpoint_type = public {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.barbican_region_name  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.cafile                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.certfile              = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.collect_timing        = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.insecure              = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.keyfile               = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.number_of_retries     = 60 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.retry_delay           = 1 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.send_service_user_token = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.split_loggers         = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.timeout               = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.verify_ssl            = True {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican.verify_ssl_path       = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.auth_section = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.auth_type = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.198s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.cafile   = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.certfile = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.collect_timing = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.insecure = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.keyfile  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.split_loggers = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] barbican_service_user.timeout  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.approle_role_id          = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.approle_secret_id        = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.kv_mountpoint            = secret {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.kv_path                  = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.kv_version               = 2 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.namespace                = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.root_token_id            = **** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.ssl_ca_crt_file          = None {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.timeout                  = 60.0 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.use_ssl                  = False {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:29:51 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] ******************************************************************************** {{(pid=76719) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:51 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:51 devstack sudo[76921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 24 17:29:51 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:29:53 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root
Sep 24 17:29:53 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.016s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:53 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:53 devstack sudo[77037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:29:53 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:29:55 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root
Sep 24 17:29:55 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.004s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:55 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:29:55 devstack cinder-volume[76866]: INFO cinder.brick.local_dev.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 24 17:29:55 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:55 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.083s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:55 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:56 devstack sudo[77136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:29:56 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:29:57 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root
Sep 24 17:29:57 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.987s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:29:57 devstack cinder-volume[76866]: DEBUG cinder.brick.local_dev.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76866) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:532}}
Sep 24 17:29:57 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:29:58 devstack sudo[77228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:29:58 devstack sudo[77228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:00 devstack cinder-volume[76719]: DEBUG dbcounter [-] [76719] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76719) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:30:01 devstack sudo[77228]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:01 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.576s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:01 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:01 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:01 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:01 devstack sudo[77423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:01 devstack sudo[77423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:03 devstack sudo[77423]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:03 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.017s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:03 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:03 devstack sudo[77461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 24 17:30:03 devstack sudo[77461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:05 devstack sudo[77461]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:05 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.076s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:05 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:06 devstack sudo[77485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:30:06 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:09 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.242s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:09 devstack sudo[77554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:30:09 devstack sudo[77554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:11 devstack sudo[77554]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.902s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:12 devstack sudo[77559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:12 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:14 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.948s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:15 devstack sudo[77564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:15 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:17 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.079s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.120s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:17 devstack sudo[77572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:17 devstack sudo[77572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:19 devstack sudo[77572]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:19 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.257s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:19 devstack cinder-volume[76866]: INFO cinder.volume.drivers.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 24 17:30:19 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:19 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:19 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:19 devstack sudo[77690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:19 devstack sudo[77690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:21 devstack sudo[77690]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:21 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.980s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:21 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:30:21 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:21 devstack sudo[77772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:30:21 devstack sudo[77772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:23 devstack sudo[77772]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:23 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.238s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:23 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:24 devstack sudo[77833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:24 devstack sudo[77833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:25 devstack sudo[77833]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:25 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.993s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:25 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:26 devstack sudo[77836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:26 devstack sudo[77836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:28 devstack sudo[77836]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:28 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.114s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:28 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:28 devstack sudo[77842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:28 devstack sudo[77842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:30 devstack sudo[77842]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.899s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:30 devstack cinder-volume[76866]: INFO cinder.volume.driver [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Driver hasn't implemented _init_vendor_properties()
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG cinder.volume.driver [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76866) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG oslo_db.sqlalchemy.engines [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76866) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writer thread running {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG cinder.db.sqlalchemy.api [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Building query based on filter {{(pid=76866) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG cinder.image.image_utils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76866) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 24 17:30:30 devstack cinder-volume[76866]: INFO cinder.keymgr.migration [None req-eb160775-74b0-4154-985a-c26eeb2dbf02 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:30:30 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:30 devstack sudo[77848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:30:30 devstack sudo[77848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:32 devstack sudo[77848]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:32 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.915s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:32 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:32 devstack sudo[77873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:32 devstack sudo[77873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:34 devstack sudo[77873]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:34 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.410s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:34 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:34 devstack sudo[78015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:34 devstack sudo[78015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:36 devstack sudo[78015]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:36 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.019s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:36 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:36 devstack sudo[78029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:36 devstack sudo[78029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:38 devstack sudo[78029]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:38 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.031s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:38 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:30:39 devstack cinder-volume[76866]: INFO cinder.volume.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Driver initialization completed successfully.
Sep 24 17:30:39 devstack cinder-volume[76866]: INFO cinder.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Initiating service 2 cleanup
Sep 24 17:30:39 devstack cinder-volume[76866]: INFO cinder.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Service 2 cleanup completed.
Sep 24 17:30:39 devstack cinder-volume[76866]: DEBUG cinder.service [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Creating RPC server for service cinder-volume {{(pid=76866) start /opt/stack/cinder/cinder/service.py:239}}
Sep 24 17:30:39 devstack cinder-volume[76866]: DEBUG cinder.service [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76866) start /opt/stack/cinder/cinder/service.py:245}}
Sep 24 17:30:39 devstack cinder-volume[76866]: INFO cinder.volume.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 24 17:30:39 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:30:39 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:39 devstack sudo[78033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:30:39 devstack sudo[78033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:40 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:SELECT=3 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:30:41 devstack sudo[78033]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:41 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.273s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:41 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:41 devstack sudo[78043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:41 devstack sudo[78043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:43 devstack sudo[78043]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:43 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.054s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:43 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:43 devstack sudo[78046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:30:43 devstack sudo[78046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:45 devstack sudo[78046]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:45 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.910s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:45 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:30:45 devstack sudo[78053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:30:45 devstack sudo[78053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:30:47 devstack sudo[78053]: pam_unix(sudo:session): session closed for user root
Sep 24 17:30:47 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.994s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:30:47 devstack cinder-volume[76866]: INFO cinder.volume.manager [None req-d49c7ca0-a2a3-492d-b32d-77b340c00c4f None None] Driver post RPC initialization completed successfully.
Sep 24 17:30:57 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:30:57 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:UPDATE=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:31:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:31:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:31:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:31:10 devstack sudo[78642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:31:10 devstack sudo[78642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:31:11 devstack sudo[78642]: pam_unix(sudo:session): session closed for user root
Sep 24 17:31:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:31:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:31:12 devstack sudo[78725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:31:12 devstack sudo[78725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:31:13 devstack sudo[78725]: pam_unix(sudo:session): session closed for user root
Sep 24 17:31:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.928s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:31:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:31:14 devstack sudo[78784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:31:14 devstack sudo[78784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:31:15 devstack sudo[78784]: pam_unix(sudo:session): session closed for user root
Sep 24 17:31:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.956s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:31:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:31:16 devstack sudo[78849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:31:16 devstack sudo[78849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:31:17 devstack sudo[78849]: pam_unix(sudo:session): session closed for user root
Sep 24 17:31:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.971s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:31:17 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:32:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:32:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:32:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:32:10 devstack sudo[79468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:32:10 devstack sudo[79468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:32:11 devstack sudo[79468]: pam_unix(sudo:session): session closed for user root
Sep 24 17:32:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.915s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:32:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:32:12 devstack sudo[79476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:32:12 devstack sudo[79476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:32:13 devstack sudo[79476]: pam_unix(sudo:session): session closed for user root
Sep 24 17:32:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.930s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:32:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:32:13 devstack sudo[79487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:32:13 devstack sudo[79487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:32:15 devstack sudo[79487]: pam_unix(sudo:session): session closed for user root
Sep 24 17:32:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.781s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:32:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:32:15 devstack sudo[79497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:32:15 devstack sudo[79497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:32:17 devstack sudo[79497]: pam_unix(sudo:session): session closed for user root
Sep 24 17:32:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.802s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:32:17 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:32:58 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:SELECT=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:32:58 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:UPDATE=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:33:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:33:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:33:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:33:10 devstack sudo[80436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:33:10 devstack sudo[80436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:33:12 devstack sudo[80436]: pam_unix(sudo:session): session closed for user root
Sep 24 17:33:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.056s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:33:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:33:12 devstack sudo[80439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:33:12 devstack sudo[80439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:33:13 devstack sudo[80439]: pam_unix(sudo:session): session closed for user root
Sep 24 17:33:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.924s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:33:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:33:14 devstack sudo[80442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:33:14 devstack sudo[80442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:33:15 devstack sudo[80442]: pam_unix(sudo:session): session closed for user root
Sep 24 17:33:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.912s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:33:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:33:16 devstack sudo[80451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:33:16 devstack sudo[80451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:33:17 devstack sudo[80451]: pam_unix(sudo:session): session closed for user root
Sep 24 17:33:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.006s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:33:17 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:34:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:34:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:34:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:34:10 devstack sudo[82964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:34:10 devstack sudo[82964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:34:11 devstack sudo[82964]: pam_unix(sudo:session): session closed for user root
Sep 24 17:34:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.973s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:34:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:34:12 devstack sudo[82971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:34:12 devstack sudo[82971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:34:13 devstack sudo[82971]: pam_unix(sudo:session): session closed for user root
Sep 24 17:34:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.838s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:34:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:34:13 devstack sudo[82975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:34:13 devstack sudo[82975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:34:15 devstack sudo[82975]: pam_unix(sudo:session): session closed for user root
Sep 24 17:34:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.966s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:34:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:34:15 devstack sudo[82980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:34:15 devstack sudo[82980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:34:17 devstack sudo[82980]: pam_unix(sudo:session): session closed for user root
Sep 24 17:34:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:34:17 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:34:58 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:SELECT=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:34:58 devstack cinder-volume[76866]: DEBUG dbcounter [-] [76866] Writing DB stats cinder:UPDATE=1 {{(pid=76866) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:35:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:35:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:35:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:35:10 devstack sudo[83270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:35:10 devstack sudo[83270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:35:11 devstack sudo[83270]: pam_unix(sudo:session): session closed for user root
Sep 24 17:35:11 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.017s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:35:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:35:12 devstack sudo[83273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:35:12 devstack sudo[83273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:35:13 devstack sudo[83273]: pam_unix(sudo:session): session closed for user root
Sep 24 17:35:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.829s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:35:13 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:35:13 devstack sudo[83276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:35:13 devstack sudo[83276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:35:15 devstack sudo[83276]: pam_unix(sudo:session): session closed for user root
Sep 24 17:35:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.866s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:35:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:35:15 devstack sudo[83279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:35:15 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:35:17 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root
Sep 24 17:35:17 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.951s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:35:17 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:36:09 devstack cinder-volume[76866]: DEBUG oslo_service.periodic_task [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76866) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:36:09 devstack cinder-volume[76866]: DEBUG cinder.volume.drivers.lvm [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Updating volume stats {{(pid=76866) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 17:36:09 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:10 devstack sudo[84048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 17:36:10 devstack sudo[84048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:36:12 devstack sudo[84048]: pam_unix(sudo:session): session closed for user root
Sep 24 17:36:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.675s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:12 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:12 devstack sudo[84098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:36:12 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:36:15 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root
Sep 24 17:36:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.783s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:15 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:15 devstack sudo[84135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 17:36:15 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:36:18 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root
Sep 24 17:36:18 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.618s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:18 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:18 devstack sudo[84171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 17:36:18 devstack sudo[84171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:36:20 devstack sudo[84171]: pam_unix(sudo:session): session closed for user root
Sep 24 17:36:20 devstack cinder-volume[76866]: DEBUG oslo_concurrency.processutils [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.233s {{(pid=76866) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:20 devstack cinder-volume[76866]: DEBUG cinder.manager [None req-b4fa3ec4-2645-4a44-8af3-937223014e49 None None] Notifying Schedulers of capabilities ... {{(pid=76866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:36:20 devstack cinder-volume[76719]: INFO oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Caught SIGTERM, stopping children
Sep 24 17:36:20 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Acquiring lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 17:36:20 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Acquired lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 17:36:20 devstack cinder-volume[76719]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Releasing lock "singleton_lock" {{(pid=76719) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 17:36:20 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Stop services. {{(pid=76719) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 24 17:36:20 devstack cinder-volume[76719]: DEBUG oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Killing children. {{(pid=76719) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 24 17:36:20 devstack cinder-volume[76719]: INFO oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Waiting on 1 children to exit
Sep 24 17:36:24 devstack cinder-volume[76866]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Acquiring lock "singleton_lock" {{(pid=76866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 17:36:24 devstack cinder-volume[76866]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Acquired lock "singleton_lock" {{(pid=76866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 17:36:24 devstack cinder-volume[76866]: DEBUG oslo_concurrency.lockutils [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Releasing lock "singleton_lock" {{(pid=76866) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 17:36:24 devstack cinder-volume[76866]: WARNING amqp [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 24 17:36:24 devstack cinder-volume[76866]: WARNING amqp [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 24 17:36:24 devstack cinder-volume[76719]: INFO oslo_service.backend._eventlet.service [None req-130408fa-0f53-495e-9cf1-d8c6940e1bb9 None None] Child 76866 exited with status 0
Sep 24 17:36:41 devstack cinder-volume[84268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 17:36:41 devstack cinder-volume[84268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 17:36:41 devstack cinder-volume[84268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84268) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO dbcounter [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Registered counter for database cinder
Sep 24 17:36:45 devstack cinder-volume[84268]: DEBUG oslo_db.sqlalchemy.engines [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:36:45 devstack cinder-volume[84268]: DEBUG dbcounter [-] [84268] Writer thread running {{(pid=84268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO cinder.rpc [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO cinder.rpc [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 24 17:36:45 devstack cinder-volume[84268]: DEBUG oslo_db.sqlalchemy.engines [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO cinder.volume.manager [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Determined volume DB was empty at startup.
Sep 24 17:36:45 devstack cinder-volume[84268]: DEBUG cinder.volume.manager [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84268) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO cinder.volume.manager [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 24 17:36:45 devstack cinder-volume[84268]: WARNING stevedore.named [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 17:36:45 devstack cinder-volume[84268]: WARNING castellan.key_manager [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 17:36:45 devstack cinder-volume[84268]: WARNING cinder.keymgr.conf_key_mgr [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO cinder.volume.manager [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 24 17:36:45 devstack cinder-volume[84268]: DEBUG oslo_db.sqlalchemy.engines [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:36:45 devstack cinder-volume[84268]: INFO oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Starting 1 workers
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Started child 84502 {{(pid=84268) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Full set of CONF: {{(pid=84268) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] ******************************************************************************** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 24 17:36:46 devstack cinder-volume[84502]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Configuration options gathered from: {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] ================================================================================ {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] allow_availability_zone_fallback = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] allow_compression_on_image_upload = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] allowed_direct_url_schemes     = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] api_rate_limit                 = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] auth_strategy                  = keystone {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_availability_zone      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_host                   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_name                   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_stats_polling_interval = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backup_api_class               = cinder.backup.api.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backup_name_template           = backup-%s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backup_use_same_host           = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backup_use_temp_snapshot       = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] chap_password                  = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] chap_username                  =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_internal_tenant_project_id = c36db0cb26864c979e777959cb939824 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_internal_tenant_user_id = f0b8098cb03d4a76b6266a423ec45163 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cluster                        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] compression_format             = gzip {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] compute_api_class              = cinder.compute.nova.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] config_dir                     = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] config_source                  = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] control_exchange               = openstack {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] debug                          = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] default_availability_zone      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] default_group_type             = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] default_volume_type            = QuobyteHD {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_client_cert             = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_client_cert_key         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_data_namespace          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_ssl_cert_path           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_ssl_cert_verify         = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] driver_use_ssl                 = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] enable_new_services            = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] enable_unsupported_driver      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] enabled_backends               = ['QuobyteHD'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] enforce_multipath_for_image_xfer = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] filter_function                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_api_insecure            = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_api_servers             = ['http://192.168.122.72/image'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_api_ssl_compression     = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_ca_certificates_file    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_catalog_info            = image:glance:publicURL {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_certfile                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_keyfile                 = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_num_retries             = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance_request_timeout         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] goodness_function              = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] graceful_shutdown_timeout      = 5 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] group_api_class                = cinder.group.api.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] host                           = devstack {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_compress_on_upload       = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_conversion_address_space_limit = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_conversion_cpu_limit     = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_conversion_disable       = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_upload_use_cinder_backend = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_upload_use_internal_tenant = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_volume_cache_enabled     = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_volume_cache_max_count   = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] image_volume_cache_max_size_gb = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] init_host_max_objects_retrieval = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] instance_format                = [instance: %(uuid)s]  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iscsi_iotype                   = fileio {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iscsi_target_flags             =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iscsi_write_cache              = on {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iser_helper                    = tgtadm {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iser_ip_address                = 192.168.122.72 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iser_port                      = 3260 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_color                      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_config_append              = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_dir                        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_file                       = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_options                    = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_rotate_interval            = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_rotate_interval_type       = days {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] log_rotation_type              = none {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] max_age                        = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] max_logfile_count              = 30 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] max_logfile_size_mb            = 200 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] max_over_subscription_ratio    = 20.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] message_reap_interval          = 86400 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] message_ttl                    = 2592000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] migration_create_volume_timeout_secs = 300 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] monkey_patch                   = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] monkey_patch_modules           = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] my_ip                          = 192.168.122.72 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] no_snapshot_gb_quota           = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] num_iser_scan_tries            = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] num_shell_tries                = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] num_volume_device_scan_tries   = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] nvmeof_conn_info_version       = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] nvmet_ns_id                    = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] nvmet_port_id                  = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_max_limit                = 1000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_ext_list          = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_listen_port       = 8776 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_use_ssl           = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] osapi_volume_workers           = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] per_volume_size_limit          = -1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] periodic_fuzzy_delay           = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] periodic_interval              = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] public_endpoint                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] publish_errors                 = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_backup_gigabytes         = 1000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_backups                  = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_gigabytes                = 1000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_groups                   = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_snapshots                = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] quota_volumes                  = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] rate_limit_burst               = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] rate_limit_except_level        = CRITICAL {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] rate_limit_interval            = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] reinit_driver_count            = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] replication_device             = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] report_discard_supported       = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] report_interval                = 120 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] reservation_clean_interval     = 86400 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] reservation_expire             = 86400 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] reserved_image_namespaces      = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] reserved_percentage            = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] rpc_response_timeout           = 120 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] run_external_periodic_tasks    = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] scst_target_driver             = iscsi {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] scst_target_iqn_name           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_down_time              = 720 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] shell_completion               = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] snapshot_name_template         = snapshot-%s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] split_loggers                  = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] state_path                     = /opt/stack/data/cinder {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] storage_availability_zone      = nova {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] storage_protocol               = iSCSI {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] syslog_log_facility            = LOG_USER {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_helper                  = lioadm {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_ip_address              = 192.168.122.72 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_port                    = 3260 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_protocol                = iscsi {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] target_secondary_ip_addresses  = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] trace_flags                    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] transport_url                  = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] until_refresh                  = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_chap_auth                  = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_default_quota_class        = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_journal                    = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_json                       = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_multipath_for_image_xfer   = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_stderr                     = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] use_syslog                     = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] verify_glance_signatures       = enabled {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_api_class               = cinder.volume.api.API {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_backend_name            = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_clear                   = zero {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_clear_ionice            = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_clear_size              = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_copy_bps_limit          = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_dd_blocksize            = 1M {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_name_template           = volume-%s {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_service_inithost_offload = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volume_usage_audit_period      = month {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] watch_log_file                 = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] zoning_mode                    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_concurrency.disable_process_locking = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.admin_password = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84502) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.admin_token = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.admin_user  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_port   = 35357 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_protocol = https {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_section = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_type   = password {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_uri    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.auth_version = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.cache       = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.certfile    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.delay_auth_decision = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.http_connect_timeout = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.identity_uri = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.include_service_catalog = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.insecure    = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.interface   = public {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.keyfile     = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_password =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcache_username =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.region_name = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.service_token_roles_required = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.service_type = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.token_cache_time = 300 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.backend                  = dogpile.cache.null {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.backend_argument         = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.backend_expiration_time  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.config_prefix            = cache.oslo {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.dead_timeout             = 60.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.debug_cache_backend      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.enable_retry_client      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.enable_socket_keepalive  = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.enabled                  = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.enforce_fips_mode        = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.expiration_time          = 600 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.hashclient_retry_attempts = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_dead_retry      = 300 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_password        = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_pool_maxsize    = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_sasl_enabled    = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.memcache_username        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.proxies                  = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_db                 = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_password           = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_sentinel_service_name = mymaster {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_server             = localhost:6379 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_socket_timeout     = 1.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.redis_username           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.retry_attempts           = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.retry_delay              = 0.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.socket_keepalive_count   = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.socket_keepalive_idle    = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.socket_keepalive_interval = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.tls_allowed_ciphers      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.tls_cafile               = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.tls_certfile             = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.tls_enabled              = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cache.tls_keyfile              = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] coordination.backend_url       = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.asyncio_connection    = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.asyncio_slave_connection = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.backend               = sqlalchemy {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.connection            = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.connection_debug      = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.connection_parameters =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.connection_recycle_time = 3600 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.connection_trace      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.db_inc_retry_interval = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.db_max_retries        = 20 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.db_max_retry_interval = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.db_retry_interval     = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.max_overflow          = 50 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.max_pool_size         = 5 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.max_retries           = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.mysql_wsrep_sync_wait = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.pool_timeout          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.retry_interval        = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.slave_connection      = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.sqlite_synchronous    = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] database.use_db_reconnect      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.connection_string     = messaging:// {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.enabled               = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.es_doc_type           = notification {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.es_scroll_size        = 10000 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.es_scroll_time        = 2m {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.filter_error_trace    = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.hmac_keys             = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.sentinel_service_name = mymaster {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.socket_timeout        = 0.1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.trace_requests        = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler.trace_sqlalchemy      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler_jaeger.process_tags   = {} {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler_jaeger.service_name_prefix = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] profiler_otlp.service_name_prefix = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.enforce_new_defaults = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: WARNING oslo_config.cfg [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.enforce_scope      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.policy_default_rule = default {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.policy_file        = policy.yaml {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.group          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.helper_command = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.thread_pool_size = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] privsep_osbrick.user           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.group         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.helper_command = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] cinder_sys_admin.user          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.auth_section      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.auth_type         = password {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.certfile          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.collect_timing    = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.insecure          = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.keyfile           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.send_service_user_token = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.split_loggers     = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] service_user.timeout           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.auth_section            = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.auth_type               = password {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.certfile                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.collect_timing          = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.insecure                = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.keyfile                 = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.split_loggers           = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] glance.timeout                 = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.backend_availability_zone = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.chap_password = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.chap_username =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_client_cert = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_client_cert_key = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_data_namespace = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.driver_use_ssl = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.enable_unsupported_driver = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.extra_capabilities = {} {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.filter_function = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.goodness_function = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iscsi_iotype  = fileio {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iscsi_target_flags =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iscsi_write_cache = on {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iser_helper   = tgtadm {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iser_port     = 3260 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_host      =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_login     = admin {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_mount_options = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_password  = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_private_key =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_share_path =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_ssh_port  = 22 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.num_shell_tries = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.nvmet_port_id = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_client_cfg = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:46 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.quobyte_volume_url = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.replication_device = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.report_discard_supported = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.reserved_percentage = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.scst_target_driver = iscsi {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.scst_target_iqn_name = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.storage_protocol = iSCSI {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_helper = tgtadm {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_port   = 3260 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_protocol = iscsi {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.trace_flags   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.unique_fqdn_network = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.use_chap_auth = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_backend_name = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_clear  = zero {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_clear_ionice = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_clear_size = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_reports.file_event_handler = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_reports.log_dir           = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.backend_availability_zone = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.backend_host         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.chap_password        = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.chap_username        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.chiscsi_conf         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_client_cert   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_client_cert_key = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_data_namespace = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.driver_use_ssl       = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.extra_capabilities   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.filter_function      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.goodness_function    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iscsi_iotype         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iscsi_target_flags   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iscsi_write_cache    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iser_helper          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iser_ip_address      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iser_port            = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.iser_target_prefix   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_host             = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_login            = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_mount_options    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_password         = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_private_key      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_secure_file_operations = true {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_share_path       = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_ssh_port         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.num_shell_tries      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nvmet_ns_id          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.nvmet_port_id        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.replication_device   = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.report_discard_supported = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.reserved_percentage  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.scst_target_driver   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.storage_protocol     = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_helper        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_ip_address    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_port          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_prefix        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_protocol      = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.trace_flags          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.unique_fqdn_network  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.use_chap_auth        = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_clear         = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_clear_ionice  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_clear_size    = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] QuobyteHD.volumes_dir          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84502) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 24 17:36:47 devstack cinder-volume[84502]: INFO cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Running cmd (subprocess): mount.quobyte {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl      = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_notifications.driver = [] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_notifications.retry = -1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] oslo_messaging_notifications.transport_url = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] key_manager.fixed_key          = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.barbican_api_version  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.barbican_endpoint     = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.barbican_endpoint_type = public {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.barbican_region_name  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.cafile                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.certfile              = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.collect_timing        = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.insecure              = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.keyfile               = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.number_of_retries     = 60 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.retry_delay           = 1 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.send_service_user_token = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.split_loggers         = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.timeout               = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.verify_ssl            = True {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican.verify_ssl_path       = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.auth_section = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.auth_type = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.cafile   = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.certfile = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.collect_timing = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.insecure = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.keyfile  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.split_loggers = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] barbican_service_user.timeout  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.approle_role_id          = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.approle_secret_id        = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.kv_mountpoint            = secret {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.kv_path                  = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.kv_version               = 2 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.namespace                = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.root_token_id            = **** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.ssl_ca_crt_file          = None {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.timeout                  = 60.0 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.use_ssl                  = False {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 17:36:47 devstack cinder-volume[84268]: DEBUG oslo_service.backend._eventlet.service [None req-929c9e56-b289-417c-9287-4fd40cde449b None None] ******************************************************************************** {{(pid=84268) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 24 17:36:47 devstack quobyte-client[84521]: Reading configuration file: /etc/quobyte/client.cfg
Sep 24 17:36:47 devstack quobyte-client[84521]: Invalid parameters found, error: missing mount point.
Sep 24 17:36:47 devstack quobyte-client[84521]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 24 17:36:47 devstack quobyte-client[84521]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] CMD "mount.quobyte" returned: 1 in 0.393s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:36:47 devstack cinder-volume[84502]: INFO cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Mounting volume: 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 ...
Sep 24 17:36:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 -c /etc/quobyte/client-cinder.cfg {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:47 devstack quobyte-client[84527]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 24 17:36:47 devstack quobyte-client[84527]: Reading configuration file: /etc/quobyte/client.cfg
Sep 24 17:36:47 devstack quobyte-client[84527]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9' to display the log.
Sep 24 17:36:47 devstack quobyte-client[84528]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 24 17:36:47 devstack quobyte-client[84528]: mount.quobyte 3.25 (4fbbd59204)
Sep 24 17:36:47 devstack quobyte-client[84528]: Client UUID: onYpXKyP-hDsY-UMoa-nMfA-UFBUzMXdCQQN
Sep 24 17:36:47 devstack quobyte-client[84528]: Registry: osci01.corp.quobyte.com:7861
Sep 24 17:36:47 devstack quobyte-client[84528]: Volume: cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:36:47 devstack quobyte-client[84528]: FUSE version: 316
Sep 24 17:36:47 devstack quobyte-client[84528]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 24 17:36:47 devstack quobyte-client[84528]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 24 17:36:47 devstack quobyte-client[84528]: Setting total object cache size to 3352297472 bytes
Sep 24 17:36:47 devstack quobyte-client[84528]: Using FUSE low-level API
Sep 24 17:36:47 devstack quobyte-client[84528]: Caching of uid/gid to user/group name mappings is enabled
Sep 24 17:36:47 devstack quobyte-client[84528]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 24 17:36:47 devstack quobyte-client[84528]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 24 17:36:47 devstack quobyte-client[84528]: HTTP server started on port 55000
Sep 24 17:36:47 devstack quobyte-client[84528]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 24 17:36:48 devstack quobyte-client[84528]: Mount point /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 established
Sep 24 17:36:48 devstack quobyte-client[84528]: TimeSync is running and remote sync every 60 seconds
Sep 24 17:36:48 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:48 devstack quobyte-client[84528]: Ignored time synchronization message because time source took too long to respond (65 ms)
Sep 24 17:36:48 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:48 devstack quobyte-client[84528]: Opening volume cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 (fb1a4dd2-d3e0-42e2-9298-fa1a55536627)
Sep 24 17:36:48 devstack quobyte-client[84528]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 24 17:36:48 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:48 devstack quobyte-client[84528]: Changed metadata cache configuration for volume fb1a4dd2-d3e0-42e2-9298-fa1a55536627 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 24 17:36:48 devstack quobyte-client[84528]: Failed to invalidate inode: 38: Function not implemented
Sep 24 17:36:48 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:48 devstack quobyte-client[84528]: Automatic minidump upload enabled by global system configuration
Sep 24 17:36:48 devstack quobyte-client[84528]: Announcing HTTP status server address 172.24.4.1
Sep 24 17:36:48 devstack quobyte-client[84528]: Registered as service (uuid onYpXKyP-hDsY-UMoa-nMfA-UFBUzMXdCQQN)
Sep 24 17:36:48 devstack quobyte-client[84528]: Quobyte Client running as pid 84528
Sep 24 17:36:48 devstack quobyte-client[84528]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 24 17:36:48 devstack quobyte-client[84528]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.722s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:48 devstack cinder-volume[84502]: INFO cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Mounting volume: 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 succeeded
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.780s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:48 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.092s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:48 devstack cinder-volume[84502]: INFO cinder.volume.driver [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Driver hasn't implemented _init_vendor_properties()
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.volume.driver [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.915470123291, 'free_capacity_gb': 924.915470123291, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84502) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_db.sqlalchemy.engines [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84502) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writer thread running {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.db.sqlalchemy.api [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Building query based on filter {{(pid=84502) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84502) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 24 17:36:48 devstack cinder-volume[84502]: INFO cinder.keymgr.migration [None req-ace2be11-4f25-4294-b4dc-81623216e4f3 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:36:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Driver initialization completed successfully.
Sep 24 17:36:49 devstack cinder-volume[84502]: INFO cinder.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Initiating service 3 cleanup
Sep 24 17:36:49 devstack cinder-volume[84502]: INFO cinder.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Service 3 cleanup completed.
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG cinder.service [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Creating RPC server for service cinder-volume {{(pid=84502) start /opt/stack/cinder/cinder/service.py:239}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG cinder.service [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84502) start /opt/stack/cinder/cinder/service.py:245}}
Sep 24 17:36:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 24 17:36:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:36:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:36:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:36:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-a1895cb5-82b6-4c4d-8c1f-100a3449eb02 None None] Driver post RPC initialization completed successfully.
Sep 24 17:36:50 devstack quobyte-client[84528]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 17:36:55 devstack cinder-volume[84268]: DEBUG dbcounter [-] [84268] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84268) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:36:59 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:37:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:38:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Flow 'volume_create_manager' (eac49c4e-6ae6-4412-9430-0836d83f2a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb270694-661f-4e60-b6bc-16ebe24c1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb270694-661f-4e60-b6bc-16ebe24c1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1220570948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f7cbe-b4c8-485e-be51-c32b7b9962ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9d42b5be5e486ab796929f025bdabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:38:08Z,use_quota=True,user_id='871269533636409588ef95ccde8dbc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77736325-42ef-4d8b-95a3-ae39614579b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77736325-42ef-4d8b-95a3-ae39614579b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71906df7-d8a6-41e8-a7a1-42a0fc553262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71906df7-d8a6-41e8-a7a1-42a0fc553262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7f7cbe-b4c8-485e-be51-c32b7b9962ec', 'volume_name': 'volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb726db-8294-4b44-bbf5-905e48561879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb726db-8294-4b44-bbf5-905e48561879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5af5e35-671f-485a-a22d-a201aefafb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:08 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume 1f7f7cbe-b4c8-485e-be51-c32b7b9962ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec', 'volume_size': 1}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1220570948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f7cbe-b4c8-485e-be51-c32b7b9962ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9d42b5be5e486ab796929f025bdabe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:38:08Z,use_quota=True,user_id='871269533636409588ef95ccde8dbc60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Creating volume 1f7f7cbe-b4c8-485e-be51-c32b7b9962ec {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:38:08 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:38:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:38:08 devstack quobyte-client[84528]: System call of process 84911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:38:09 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=2, name=volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:38:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec 1073741824" returned: 0 in 1.416s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:38:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:38:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" returned: 0 in 0.282s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:38:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] <== create_volume: return (1868ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:38:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:38:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5af5e35-671f-485a-a22d-a201aefafb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af064aa-6673-466d-a3c5-814bf601f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:38:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec (1f7f7cbe-b4c8-485e-be51-c32b7b9962ec): created successfully
Sep 24 17:38:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af064aa-6673-466d-a3c5-814bf601f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:38:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Flow 'volume_create_manager' (eac49c4e-6ae6-4412-9430-0836d83f2a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:38:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0960efa0-54e7-4b3f-b9a1-c5d0c5db65fa tempest-VolumesAssistedSnapshotsTest-1090977862 None] Created volume successfully.
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.257s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:38:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:38:21 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:38:21 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:39:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.322s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:39:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Flow 'volume_create_manager' (cb7a16db-b0e2-429e-9ae2-1258a48692db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbb17d3-e886-49cf-aa72-9cef65e8ddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bbb17d3-e886-49cf-aa72-9cef65e8ddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457734328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acd5b91-bb43-407e-9c42-610c674c9b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aef553f9249425a9faa24ad87168851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:39:36Z,use_quota=True,user_id='758923e1e54846feaacea0b1939fb688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e43d447-e9bd-4c2e-b74e-8f876b19b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e43d447-e9bd-4c2e-b74e-8f876b19b599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3a16ad-a71f-4bd9-8ce3-cc57be85d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a3a16ad-a71f-4bd9-8ce3-cc57be85d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7acd5b91-bb43-407e-9c42-610c674c9b1d', 'volume_name': 'volume-7acd5b91-bb43-407e-9c42-610c674c9b1d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba728e0c-9aa9-407e-bdaa-dbb757e6a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba728e0c-9aa9-407e-bdaa-dbb757e6a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c178e8-a9af-4b95-b5a0-09ec96dbd9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Volume 7acd5b91-bb43-407e-9c42-610c674c9b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7acd5b91-bb43-407e-9c42-610c674c9b1d', 'volume_size': 1}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1457734328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acd5b91-bb43-407e-9c42-610c674c9b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aef553f9249425a9faa24ad87168851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:39:36Z,use_quota=True,user_id='758923e1e54846feaacea0b1939fb688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Creating volume 7acd5b91-bb43-407e-9c42-610c674c9b1d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:39:36 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:36 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=3, name=volume-7acd5b91-bb43-407e-9c42-610c674c9b1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d 1073741824" returned: 0 in 0.511s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] <== create_volume: return (727ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c178e8-a9af-4b95-b5a0-09ec96dbd9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7acd5b91-bb43-407e-9c42-610c674c9b1d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb37e271-6417-43c8-bc63-2f8cd4728f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:37 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Volume volume-7acd5b91-bb43-407e-9c42-610c674c9b1d (7acd5b91-bb43-407e-9c42-610c674c9b1d): created successfully
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb37e271-6417-43c8-bc63-2f8cd4728f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Flow 'volume_create_manager' (cb7a16db-b0e2-429e-9ae2-1258a48692db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:39:37 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1894a9b8-cf70-4698-be1e-20bce7d8fc96 tempest-ServersNegativeTestJSON-34701165 None] Created volume successfully.
Sep 24 17:39:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Flow 'volume_create_manager' (32bb90aa-cc98-4a20-916d-73cd019f18b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec65e65-0531-4607-98ea-aa3b2482631b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fec65e65-0531-4607-98ea-aa3b2482631b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1616887843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9907ad4-b494-46b3-bd6f-f30f3f58fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aef553f9249425a9faa24ad87168851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:39:40Z,use_quota=True,user_id='758923e1e54846feaacea0b1939fb688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dca2c6-38e5-4c3e-a22b-7841d896b423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51dca2c6-38e5-4c3e-a22b-7841d896b423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a18c0c4-642c-49de-a749-0e65d4654794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a18c0c4-642c-49de-a749-0e65d4654794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9907ad4-b494-46b3-bd6f-f30f3f58fbeb', 'volume_name': 'volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9197f07d-f7ea-49d2-a377-6f769e62257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9197f07d-f7ea-49d2-a377-6f769e62257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3daea681-f8f9-499a-a10f-541838680ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:39 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Volume d9907ad4-b494-46b3-bd6f-f30f3f58fbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb', 'volume_size': 1}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1616887843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9907ad4-b494-46b3-bd6f-f30f3f58fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aef553f9249425a9faa24ad87168851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:39:40Z,use_quota=True,user_id='758923e1e54846feaacea0b1939fb688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Creating volume d9907ad4-b494-46b3-bd6f-f30f3f58fbeb {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:39:39 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:39:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:40 devstack quobyte-client[84528]: System call of process 85797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:40 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=4, name=volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:39:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb 1073741824" returned: 0 in 0.712s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" returned: 0 in 0.149s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:39:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3daea681-f8f9-499a-a10f-541838680ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a312e6-5761-4fef-8963-dfdd15e1a586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:39:41 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Volume volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb (d9907ad4-b494-46b3-bd6f-f30f3f58fbeb): created successfully
Sep 24 17:39:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a312e6-5761-4fef-8963-dfdd15e1a586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:39:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Flow 'volume_create_manager' (32bb90aa-cc98-4a20-916d-73cd019f18b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:39:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cd9ee6e0-456e-405f-94b8-27f757469bdc tempest-ServersNegativeTestJSON-34701165 None] Created volume successfully.
Sep 24 17:39:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "cinder-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:39:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:39:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:39:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "cinder-quobyte-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:39:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-quobyte-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:39:42 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4wlxh5eo/privsep.sock']
Sep 24 17:39:42 devstack sudo[85801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4wlxh5eo/privsep.sock
Sep 24 17:39:42 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:39:52 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root
Sep 24 17:39:52 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Spawned new privsep daemon via rootwrap
Sep 24 17:39:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Accepted privsep connection to /tmp/tmp4wlxh5eo/privsep.sock {{(pid=84502) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 24 17:39:52 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 24 17:39:52 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 24 17:39:52 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 24 17:39:52 devstack cinder-volume[84502]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85879
Sep 24 17:39:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8082bac7-f920-4b0b-8065-ee0785c18714]: (2,) {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:39:52 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:39:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c869e2-0325-4b0c-933e-677b9bf3ef1d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:39:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:53 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:39:53 devstack quobyte-client[84528]: System call of process 85895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:53 devstack quobyte-client[84528]: System call of process 85895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" returned: 0 in 1.105s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" returned: 0 in 0.281s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-quobyte-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb" released by "delete_volume" :: held 11.559s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:39:55 devstack cinder-volume[84502]: WARNING cinder.quota [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:39:55 devstack cinder-volume[84502]: WARNING cinder.quota [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Created reservations ['0b4c1e8d-0c10-4d8b-be61-e0fbfe174aae', '60950691-3e30-4fe7-9fbe-668a5b7d1710', '381ecc07-8a96-4b70-b946-683d3989ca63', 'bd4654d4-fbe1-4de4-b7e1-d289b7fc71ed'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.188s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:56 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:39:56 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Deleted volume successfully.
Sep 24 17:39:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-12b84d34-93e8-4c9f-885e-746b70c7c797 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-d9907ad4-b494-46b3-bd6f-f30f3f58fbeb-delete_volume" released by "delete_volume" :: held 13.677s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:39:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "cinder-7acd5b91-bb43-407e-9c42-610c674c9b1d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:39:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-7acd5b91-bb43-407e-9c42-610c674c9b1d-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:39:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:39:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "cinder-quobyte-7acd5b91-bb43-407e-9c42-610c674c9b1d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:39:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-quobyte-7acd5b91-bb43-407e-9c42-610c674c9b1d" acquired by "delete_volume" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:39:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff72fd59-59f1-4b08-bfe2-f70fb6ea0c80]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:39:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:57 devstack quobyte-client[84528]: System call of process 85901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:57 devstack quobyte-client[84528]: System call of process 85901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:57 devstack quobyte-client[84528]: System call of process 85901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d" returned: 0 in 0.894s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7acd5b91-bb43-407e-9c42-610c674c9b1d" returned: 0 in 0.171s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-quobyte-7acd5b91-bb43-407e-9c42-610c674c9b1d" released by "delete_volume" :: held 1.326s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Created reservations ['2b84ac32-56bc-4918-99cf-89ffcd8c618e', 'f7472e12-bf3a-4744-bf58-88db14d916a9', '04ee2ed9-1154-4b9d-a172-2ac4230fa3a1', '737eee9f-2b58-43dc-863e-15fe4379410f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:39:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.280s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:39:59 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:39:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Deleted volume successfully.
Sep 24 17:40:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3c56ef68-fc90-43a8-af16-137865280d82 tempest-ServersNegativeTestJSON-34701165 None] Lock "cinder-7acd5b91-bb43-407e-9c42-610c674c9b1d-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:40:08 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=20 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:40:10 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:INSERT=6,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.206s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:40:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:40:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Flow 'volume_create_manager' (c0e086a3-35ab-409a-88a9-7cacc05ccc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9951d3-bd2f-4861-9270-ff2d13eb097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f9951d3-bd2f-4861-9270-ff2d13eb097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1285495511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c52fe91-debb-485d-b429-2c18dd0b3281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564406fc6b44a6d9c3888f7a1ae3d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:40:26Z,use_quota=True,user_id='dc12c15201df47dba5ee97a5930395ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d60b11-9bd9-4e6c-b1a2-f4bc7ddd5e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d60b11-9bd9-4e6c-b1a2-f4bc7ddd5e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b710743d-fdd5-4d82-b763-a281a72ac81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b710743d-fdd5-4d82-b763-a281a72ac81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c52fe91-debb-485d-b429-2c18dd0b3281', 'volume_name': 'volume-2c52fe91-debb-485d-b429-2c18dd0b3281', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33750873-2d5a-4679-af8b-beb0e1d19deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33750873-2d5a-4679-af8b-beb0e1d19deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b035a74-69b2-441c-b491-ae0ca9ee8850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume 2c52fe91-debb-485d-b429-2c18dd0b3281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c52fe91-debb-485d-b429-2c18dd0b3281', 'volume_size': 1}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1285495511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c52fe91-debb-485d-b429-2c18dd0b3281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0564406fc6b44a6d9c3888f7a1ae3d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:40:26Z,use_quota=True,user_id='dc12c15201df47dba5ee97a5930395ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Creating volume 2c52fe91-debb-485d-b429-2c18dd0b3281 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:40:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:40:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:40:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.084s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:40:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:40:27 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:40:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:40:27 devstack quobyte-client[84528]: System call of process 85979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:27 devstack quobyte-client[84528]: System call of process 85979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:27 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=5, name=volume-2c52fe91-debb-485d-b429-2c18dd0b3281, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:40:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 1073741824" returned: 0 in 1.620s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:40:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:40:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281" returned: 0 in 0.174s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:40:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] <== create_volume: return (1966ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:40:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:40:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b035a74-69b2-441c-b491-ae0ca9ee8850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c52fe91-debb-485d-b429-2c18dd0b3281', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4916f5-d54b-4605-b299-32d6a397877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:40:29 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume volume-2c52fe91-debb-485d-b429-2c18dd0b3281 (2c52fe91-debb-485d-b429-2c18dd0b3281): created successfully
Sep 24 17:40:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4916f5-d54b-4605-b299-32d6a397877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:40:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Flow 'volume_create_manager' (c0e086a3-35ab-409a-88a9-7cacc05ccc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:40:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d8e1fa9e-c7dc-4b89-beb8-1946fdf8e936 tempest-AttachSCSIVolumeTestJSON-454388774 None] Created volume successfully.
Sep 24 17:40:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:40:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:40:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:40:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:40:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d347ca55-2226-4887-b15e-147ad849227c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:40:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:40:44 devstack quobyte-client[84528]: System call of process 86018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:44 devstack quobyte-client[84528]: System call of process 86018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:44 devstack quobyte-client[84528]: System call of process 86018 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281" returned: 0 in 1.064s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:40:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.153s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:40:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-2c52fe91-debb-485d-b429-2c18dd0b3281', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c21a78a7-b306-4262-ba18-56cb8555d963', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:40:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:40:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-d16a07f4-f3a5-4314-a79d-c2f51d9bbd08 req-133ea5bc-24fb-42fa-bbd9-bcba4fe36284 tempest-AttachSCSIVolumeTestJSON-454388774 None] attachment_update completed successfully.
Sep 24 17:40:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:40:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:40:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce02ee7-6420-4712-b372-9a167b27ad7a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:40:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:40:54 devstack quobyte-client[84528]: System call of process 86180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:54 devstack quobyte-client[84528]: System call of process 86180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:54 devstack quobyte-client[84528]: System call of process 86180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:54 devstack quobyte-client[84528]: System call of process 86180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:40:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" returned: 0 in 0.634s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:40:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.704s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:40:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b4ca562-0089-4485-af91-21a95476a871', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:40:55 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:40:55 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-ba58e65d-9fad-427e-bc2c-6d5039a9c848 req-5c246be5-99da-4d37-ab68-2f74d4b66ad2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] attachment_update completed successfully.
Sep 24 17:41:05 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:41:05 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.084s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:41:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-eb8c56f1-8b87-4c80-a24e-9b0401978aa1 req-6d7e9192-481d-44ab-bf81-22fb7c31f1ce tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-eb8c56f1-8b87-4c80-a24e-9b0401978aa1 req-6d7e9192-481d-44ab-bf81-22fb7c31f1ce tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:23 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-eb8c56f1-8b87-4c80-a24e-9b0401978aa1 req-6d7e9192-481d-44ab-bf81-22fb7c31f1ce tempest-AttachSCSIVolumeTestJSON-454388774 None] Terminate volume connection completed successfully.
Sep 24 17:41:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-eb8c56f1-8b87-4c80-a24e-9b0401978aa1 req-6d7e9192-481d-44ab-bf81-22fb7c31f1ce tempest-AttachSCSIVolumeTestJSON-454388774 None] Deleting attachment c21a78a7-b306-4262-ba18-56cb8555d963. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:41:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4f82152d-f94d-44aa-a2b3-b62ce3d4b2e5 req-e16e3691-dd28-494c-938b-6254ead4f45d tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4f82152d-f94d-44aa-a2b3-b62ce3d4b2e5 req-e16e3691-dd28-494c-938b-6254ead4f45d tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4f82152d-f94d-44aa-a2b3-b62ce3d4b2e5 req-e16e3691-dd28-494c-938b-6254ead4f45d tempest-VolumesAssistedSnapshotsTest-1090977862 None] Terminate volume connection completed successfully.
Sep 24 17:41:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4f82152d-f94d-44aa-a2b3-b62ce3d4b2e5 req-e16e3691-dd28-494c-938b-6254ead4f45d tempest-VolumesAssistedSnapshotsTest-1090977862 None] Deleting attachment 2b4ca562-0089-4485-af91-21a95476a871. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "cinder-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "cinder-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:41:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "cinder-quobyte-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "cinder-quobyte-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c8067a-7580-4477-93ad-fb24195ec209]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:41:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:30 devstack quobyte-client[84528]: System call of process 86684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:30 devstack quobyte-client[84528]: System call of process 86684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:30 devstack quobyte-client[84528]: System call of process 86684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:30 devstack quobyte-client[84528]: System call of process 86684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" returned: 0 in 1.144s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" returned: 0 in 0.126s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "cinder-quobyte-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec" released by "delete_volume" :: held 1.511s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Created reservations ['dbcb968b-d849-4e74-9f30-acf49007148c', 'b4af4a19-fd58-4de5-b9c6-3ccf6416c37f', 'a54ac693-2a3a-42db-a615-0a6e64c9531f', '93b8494f-13ed-4cbc-a684-08f5b207f810'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:41:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.527s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:32 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:41:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Deleted volume successfully.
Sep 24 17:41:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-71c3bc2c-68c6-4df3-b82e-66abb5c9b4f2 tempest-VolumesAssistedSnapshotsTest-1090977862 None] Lock "cinder-1f7f7cbe-b4c8-485e-be51-c32b7b9962ec-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:41:41 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5,cinder:UPDATE=14 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "cinder-2c52fe91-debb-485d-b429-2c18dd0b3281-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "cinder-2c52fe91-debb-485d-b429-2c18dd0b3281-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:41:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "cinder-quobyte-2c52fe91-debb-485d-b429-2c18dd0b3281" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "cinder-quobyte-2c52fe91-debb-485d-b429-2c18dd0b3281" acquired by "delete_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[848fe705-3220-4f41-9b0b-39425ee2adf8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:41:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:43 devstack quobyte-client[84528]: System call of process 86747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:43 devstack quobyte-client[84528]: System call of process 86747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:43 devstack quobyte-client[84528]: System call of process 86747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:41:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281" returned: 0 in 0.741s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2c52fe91-debb-485d-b429-2c18dd0b3281" returned: 0 in 0.127s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "cinder-quobyte-2c52fe91-debb-485d-b429-2c18dd0b3281" released by "delete_volume" :: held 1.122s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Created reservations ['bd6677ca-cf46-43f1-945c-144c70a5d8cb', '5da5146e-3e60-4144-b417-827af071b429', '68ae7f2f-d934-4336-834f-7a61454d63a0', '584daed6-dc27-4db5-ab75-1e582aa2468d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.143s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:41:44 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:41:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Deleted volume successfully.
Sep 24 17:41:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec4cc79f-e94b-41b5-a520-97ed1f25ec49 tempest-AttachSCSIVolumeTestJSON-454388774 None] Lock "cinder-2c52fe91-debb-485d-b429-2c18dd0b3281-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:41:54 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:41:55 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.596s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:42:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:42:16 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Flow 'volume_create_manager' (b2dd3030-a7db-4fa1-b846-388e80bad3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e763ef-166e-4442-b787-b6aa883c734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e763ef-166e-4442-b787-b6aa883c734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-127714362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4885aab-91e4-4eeb-9c17-1491bc35ab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732272111ed04dc1bc477c7ed1921c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:42:16Z,use_quota=True,user_id='93dc730bdd5148e19f7307827fc5e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770e10b5-423e-43c0-b05d-c51de167913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770e10b5-423e-43c0-b05d-c51de167913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3789ccb7-1a2e-4e25-ba65-64be4f46aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3789ccb7-1a2e-4e25-ba65-64be4f46aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4885aab-91e4-4eeb-9c17-1491bc35ab61', 'volume_name': 'volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553bd455-9222-41c9-8f92-bd0d78fb35e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553bd455-9222-41c9-8f92-bd0d78fb35e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782e094-2d61-4817-a469-b711303317f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume a4885aab-91e4-4eeb-9c17-1491bc35ab61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61', 'volume_size': 1}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-127714362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4885aab-91e4-4eeb-9c17-1491bc35ab61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732272111ed04dc1bc477c7ed1921c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:42:16Z,use_quota=True,user_id='93dc730bdd5148e19f7307827fc5e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Creating volume a4885aab-91e4-4eeb-9c17-1491bc35ab61 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:42:17 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:42:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:42:17 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=6, name=volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 1073741824" returned: 0 in 0.758s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] <== create_volume: return (1033ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d782e094-2d61-4817-a469-b711303317f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942be54e-f024-44aa-b135-33ffbf9418f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:18 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 (a4885aab-91e4-4eeb-9c17-1491bc35ab61): created successfully
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942be54e-f024-44aa-b135-33ffbf9418f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Flow 'volume_create_manager' (b2dd3030-a7db-4fa1-b846-388e80bad3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:42:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e9afb5e1-f233-47ea-bad5-de037be544ec tempest-AttachVolumeShelveTestJSON-1216312989 None] Created volume successfully.
Sep 24 17:42:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:42:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:42:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:42:49 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:42:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (6ffe7868-b741-43a7-8429-8d3bf71e44e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:42:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72570acf-db83-4a3e-9bd7-fe5c2dafcc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72570acf-db83-4a3e-9bd7-fe5c2dafcc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2678669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4295f0b-b429-446a-bd20-51e69e6a23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:42:49Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d9881e-8ef0-47a4-9c3f-2075c80b1bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d9881e-8ef0-47a4-9c3f-2075c80b1bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1200eff-10f6-4504-803c-47ae5c39e765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1200eff-10f6-4504-803c-47ae5c39e765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4295f0b-b429-446a-bd20-51e69e6a23fb', 'volume_name': 'volume-d4295f0b-b429-446a-bd20-51e69e6a23fb', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b909aa200>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc859f6-e98e-4309-919a-ac61c57e4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc859f6-e98e-4309-919a-ac61c57e4a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91b7fd3-bb2c-4b5b-95af-4e4dd85017dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:42:50 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Volume d4295f0b-b429-446a-bd20-51e69e6a23fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4295f0b-b429-446a-bd20-51e69e6a23fb', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b909aa200>}
Sep 24 17:42:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Cloning d4295f0b-b429-446a-bd20-51e69e6a23fb from image a414f1aa-0123-4732-9dda-73666cba7ecf  at location (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 17:42:52 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 17:42:52 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Image download 20.69 MB at 20.60 MB/s
Sep 24 17:42:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef647332-363b-452b-8c96-d3553d957b44]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:42:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:42:53 devstack sudo[86929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD
Sep 24 17:42:53 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:42:56 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root
Sep 24 17:42:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD" returned: 0 in 4.697s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:42:56 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf is fetched for user 5581bed7dc184b63aa206f69a65059bd. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 17:42:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6837f08-cf3b-4143-92f6-855659f39f62]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:42:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:42:57 devstack sudo[86959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD
Sep 24 17:42:57 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:43:00 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD" returned: 0 in 2.933s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2678669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4295f0b-b429-446a-bd20-51e69e6a23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:42:49Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Creating volume d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.097s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:43:00 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:43:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:00 devstack quobyte-client[84528]: System call of process 86973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:00 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=7, name=volume-d4295f0b-b429-446a-bd20-51e69e6a23fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb 1073741824" returned: 0 in 0.642s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 0.403s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] <== create_volume: return (1251ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4dc3d3-ba81-4233-895b-4b3535a73a70]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:43:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:02 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Attempting download of a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume d4295f0b-b429-446a-bd20-51e69e6a23fb. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 17:43:02 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[2568f977-f3e3-4609-bd8c-b1627ca0dead]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:43:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_d5n90y0p {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:02 devstack quobyte-client[84528]: System call of process 86978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:02 devstack quobyte-client[84528]: System call of process 86978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:02 devstack quobyte-client[84528]: System call of process 86978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61" returned: 0 in 0.924s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_d5n90y0p" returned: 0 in 0.690s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_d5n90y0p {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bae88021-0365-4f6e-83a0-33b082070eaa', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:43:03 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_d5n90y0p" returned: 1 in 0.629s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_d5n90y0p' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:43:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-c0ebfcc5-5c66-44d0-889d-2a1a83283103 req-ea234d51-5c73-4734-a4b7-b82dc6c78704 tempest-AttachVolumeShelveTestJSON-1216312989 None] attachment_update completed successfully.
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fb2e75-48b6-4e4d-aa41-7a911de1a700]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:43:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:04 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] a414f1aa-0123-4732-9dda-73666cba7ecf was qcow2, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 17:43:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:04 devstack quobyte-client[84528]: System call of process 86988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:04 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=7, name=volume-d4295f0b-b429-446a-bd20-51e69e6a23fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 1.371s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_0eup9yq2devstack@QuobyteHD, size 112.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:43:06 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Converted 112.00 MB image at 79.60 MB/s
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb 1G" returned: 0 in 0.162s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b45fd14-afc6-4e3e-a61f-3d8bb4a3059f]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:06 devstack quobyte-client[84528]: System call of process 86998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:06 devstack quobyte-client[84528]: System call of process 86998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:06 devstack quobyte-client[84528]: System call of process 86998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:06 devstack quobyte-client[84528]: System call of process 86998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 0.545s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 1 in 0.441s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Downloaded image a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume d4295f0b-b429-446a-bd20-51e69e6a23fb successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf for user 5581bed7dc184b63aa206f69a65059bd is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Marking volume d4295f0b-b429-446a-bd20-51e69e6a23fb as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Copying metadata from image a414f1aa-0123-4732-9dda-73666cba7ecf to d4295f0b-b429-446a-bd20-51e69e6a23fb. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Creating volume glance metadata for volume d4295f0b-b429-446a-bd20-51e69e6a23fb backed by image a414f1aa-0123-4732-9dda-73666cba7ecf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91b7fd3-bb2c-4b5b-95af-4e4dd85017dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4295f0b-b429-446a-bd20-51e69e6a23fb', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b909aa200>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0021952b-17c9-4330-bf7b-72a374f25ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:07 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Volume volume-d4295f0b-b429-446a-bd20-51e69e6a23fb (d4295f0b-b429-446a-bd20-51e69e6a23fb): created successfully
Sep 24 17:43:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0021952b-17c9-4330-bf7b-72a374f25ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (6ffe7868-b741-43a7-8429-8d3bf71e44e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:43:08 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-bb84f2a8-afd3-4438-9150-d3e305e88067 tempest-TaggedBootDevicesTest-1238402254 None] Created volume successfully.
Sep 24 17:43:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (45fe9f62-9b57-4f6e-afc3-5835727f5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400bf62-1bd7-4180-a4e3-5213eee40cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400bf62-1bd7-4180-a4e3-5213eee40cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1232892475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fcaef3-6114-4823-ab2a-c5bc72417e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:43:09Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786007c5-45c9-4a78-b0aa-5cf9b3c18f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786007c5-45c9-4a78-b0aa-5cf9b3c18f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce77f93-3759-4530-82d1-f3bbcca57a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce77f93-3759-4530-82d1-f3bbcca57a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fcaef3-6114-4823-ab2a-c5bc72417e43', 'volume_name': 'volume-18fcaef3-6114-4823-ab2a-c5bc72417e43', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdc4d5e-44f1-4b61-8834-0f54bd562e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdc4d5e-44f1-4b61-8834-0f54bd562e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d1cd40-aef6-4272-bf21-031deb0e6ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Volume 18fcaef3-6114-4823-ab2a-c5bc72417e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fcaef3-6114-4823-ab2a-c5bc72417e43', 'volume_size': 1}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1232892475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fcaef3-6114-4823-ab2a-c5bc72417e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:43:09Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Creating volume 18fcaef3-6114-4823-ab2a-c5bc72417e43 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:43:09 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:43:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:10 devstack quobyte-client[84528]: System call of process 87004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:10 devstack quobyte-client[84528]: System call of process 87004 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:43:10 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=8, name=volume-18fcaef3-6114-4823-ab2a-c5bc72417e43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:43:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 1073741824" returned: 0 in 0.469s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43" returned: 0 in 0.283s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] <== create_volume: return (918ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:43:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d1cd40-aef6-4272-bf21-031deb0e6ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fcaef3-6114-4823-ab2a-c5bc72417e43', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c4c54-a825-4db1-875b-645fc5979754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Volume volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 (18fcaef3-6114-4823-ab2a-c5bc72417e43): created successfully
Sep 24 17:43:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823c4c54-a825-4db1-875b-645fc5979754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (45fe9f62-9b57-4f6e-afc3-5835727f5289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:43:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-24bb10aa-09d9-4336-b4bd-a53f29b38fad tempest-TaggedBootDevicesTest-1238402254 None] Created volume successfully.
Sep 24 17:43:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (4fe4c2b4-7bab-44aa-9393-09c6ef44727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcfdf88-df40-45e9-ad30-bed01b37d573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcfdf88-df40-45e9-ad30-bed01b37d573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-990454461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a32d5d-2032-4434-a225-a63298cf74fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:43:12Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a8a97f-438c-4f23-97a7-ab371c74c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a8a97f-438c-4f23-97a7-ab371c74c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f2c57-5463-402a-a438-eb41d9f314d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f2c57-5463-402a-a438-eb41d9f314d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a32d5d-2032-4434-a225-a63298cf74fe', 'volume_name': 'volume-41a32d5d-2032-4434-a225-a63298cf74fe', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1746366-b7e4-4734-bb45-e3b7a560b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1746366-b7e4-4734-bb45-e3b7a560b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3e3ef-8886-42e0-833f-2bbb869fc35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:12 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Volume 41a32d5d-2032-4434-a225-a63298cf74fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a32d5d-2032-4434-a225-a63298cf74fe', 'volume_size': 1}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-990454461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a32d5d-2032-4434-a225-a63298cf74fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ae3d6c494745d3b0e00732f4cdfa63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:43:12Z,use_quota=True,user_id='5581bed7dc184b63aa206f69a65059bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Creating volume 41a32d5d-2032-4434-a225-a63298cf74fe {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:43:12 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:43:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:12 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=9, name=volume-41a32d5d-2032-4434-a225-a63298cf74fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:43:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe 1073741824" returned: 0 in 0.560s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe" returned: 0 in 0.192s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] <== create_volume: return (962ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:43:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b3e3ef-8886-42e0-833f-2bbb869fc35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a32d5d-2032-4434-a225-a63298cf74fe', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d03827-9456-4ebc-b234-d11592c0534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:43:14 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Volume volume-41a32d5d-2032-4434-a225-a63298cf74fe (41a32d5d-2032-4434-a225-a63298cf74fe): created successfully
Sep 24 17:43:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d03827-9456-4ebc-b234-d11592c0534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:43:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Flow 'volume_create_manager' (4fe4c2b4-7bab-44aa-9393-09c6ef44727b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:43:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6807fd5f-5cac-4d78-9356-5466b163acae tempest-TaggedBootDevicesTest-1238402254 None] Created volume successfully.
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:43:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:43:24 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=18,cinder:UPDATE=13,cinder:INSERT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:43:24 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=7,cinder:DELETE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:43:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:43:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.041s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:43:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[83577e82-8cd8-4572-b9d5-9b38896786dc]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:43:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:00 devstack quobyte-client[84528]: System call of process 87694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:00 devstack quobyte-client[84528]: System call of process 87694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:00 devstack quobyte-client[84528]: System call of process 87694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:00 devstack quobyte-client[84528]: System call of process 87694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 2.249s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 1 in 2.675s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:44:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.452s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-d4295f0b-b429-446a-bd20-51e69e6a23fb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac6bc9fc-5f0b-4da8-85b9-4fd1dbb14ebb', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:44:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:44:05 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-013f6c82-7082-484a-af07-76d8a48b8f2a tempest-TaggedBootDevicesTest-1238402254 None] attachment_update completed successfully.
Sep 24 17:44:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Flow 'volume_create_manager' (4e380a93-244d-4b61-a013-d169a6947d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9414583-beb0-4a81-9cf4-9f179ea5b721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9414583-beb0-4a81-9cf4-9f179ea5b721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-667106924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578903fc-89c8-453a-8b71-ab17fc094630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68d2524ba84440e89aaf4d758cae663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:44:08Z,use_quota=True,user_id='1084e31084984d109fb2d07291207695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a09aaf4-29b1-4463-986f-d33910b567fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a09aaf4-29b1-4463-986f-d33910b567fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4225078d-91ad-4095-9c34-645305fb9e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4225078d-91ad-4095-9c34-645305fb9e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '578903fc-89c8-453a-8b71-ab17fc094630', 'volume_name': 'volume-578903fc-89c8-453a-8b71-ab17fc094630', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7218d3f7-3ed1-45fd-922f-ffdccf56fc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7218d3f7-3ed1-45fd-922f-ffdccf56fc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2174956a-8f6d-44e9-ad15-fd225a8d0c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:08 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Volume 578903fc-89c8-453a-8b71-ab17fc094630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-578903fc-89c8-453a-8b71-ab17fc094630', 'volume_size': 1}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-667106924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578903fc-89c8-453a-8b71-ab17fc094630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d68d2524ba84440e89aaf4d758cae663',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:44:08Z,use_quota=True,user_id='1084e31084984d109fb2d07291207695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Creating volume 578903fc-89c8-453a-8b71-ab17fc094630 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:44:08 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:44:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:09 devstack quobyte-client[84528]: System call of process 87721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:09 devstack quobyte-client[84528]: System call of process 87721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:09 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=10, name=volume-578903fc-89c8-453a-8b71-ab17fc094630, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:44:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630 1073741824" returned: 0 in 1.204s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630" returned: 0 in 0.325s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] <== create_volume: return (1964ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:44:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2174956a-8f6d-44e9-ad15-fd225a8d0c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578903fc-89c8-453a-8b71-ab17fc094630', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c7b4c-55c8-49ba-9630-2a6b97e65f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:44:12 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Volume volume-578903fc-89c8-453a-8b71-ab17fc094630 (578903fc-89c8-453a-8b71-ab17fc094630): created successfully
Sep 24 17:44:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c7b4c-55c8-49ba-9630-2a6b97e65f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:44:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Flow 'volume_create_manager' (4e380a93-244d-4b61-a013-d169a6947d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:44:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f0df618f-6cf6-46bc-a7c4-9e96fa91227c tempest-VolumesAdminNegativeTest-885581013 None] Created volume successfully.
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Acquiring lock "cinder-578903fc-89c8-453a-8b71-ab17fc094630-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "cinder-578903fc-89c8-453a-8b71-ab17fc094630-delete_volume" acquired by "delete_volume" :: waited 0.565s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be649b-6103-4a72-8343-c16bf0e80c77]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:44:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:15 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:44:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Acquiring lock "cinder-quobyte-578903fc-89c8-453a-8b71-ab17fc094630" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:44:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "cinder-quobyte-578903fc-89c8-453a-8b71-ab17fc094630" acquired by "delete_volume" :: waited 0.101s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:44:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5116f-58fe-4516-a31c-222a82bc47fe]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:44:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:16 devstack quobyte-client[84528]: System call of process 87734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:16 devstack quobyte-client[84528]: System call of process 87734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:16 devstack quobyte-client[84528]: System call of process 87734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.058s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.120s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43" returned: 0 in 2.313s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.717s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:17 devstack quobyte-client[84528]: System call of process 87736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:17 devstack quobyte-client[84528]: System call of process 87736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:17 devstack quobyte-client[84528]: System call of process 87736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:17 devstack quobyte-client[84528]: System call of process 87736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:44:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 1.728s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:18 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:44:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630" returned: 0 in 3.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-18fcaef3-6114-4823-ab2a-c5bc72417e43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c2126e1-71a3-47aa-85b4-b78e2dc7aa0a', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:44:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:44:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-578903fc-89c8-453a-8b71-ab17fc094630" returned: 0 in 1.656s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-c65faf1c-5a43-459c-86fe-bd2b0afdc437 tempest-TaggedBootDevicesTest-1238402254 None] attachment_update completed successfully.
Sep 24 17:44:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "cinder-quobyte-578903fc-89c8-453a-8b71-ab17fc094630" released by "delete_volume" :: held 5.217s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Created reservations ['3adfb9d3-7ebe-4bd4-aa3b-dfbc3fd709a5', '69918cb4-0697-40a6-b995-f8891f459493', 'e584e636-be82-4b23-8ae0-553a18e1b69b', '670a97fd-924e-4154-8481-b1c18925e979'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.233s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:21 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:44:21 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Deleted volume successfully.
Sep 24 17:44:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dae453c-972b-4760-bc22-d65d0a65ea8f tempest-VolumesAdminNegativeTest-885581013 None] Lock "cinder-578903fc-89c8-453a-8b71-ab17fc094630-delete_volume" released by "delete_volume" :: held 7.860s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:44:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:44:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:44:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f474fac0-896c-41f4-aa51-424c568c4e10]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:44:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:44:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe" returned: 0 in 1.228s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:44:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.513s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:44:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-41a32d5d-2032-4434-a225-a63298cf74fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '549535a4-8ad4-481d-93a0-da82ce7d5ab9', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:44:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:44:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-61a7ac3b-e5df-4331-ae14-0b93f3296ff0 req-978c14d1-af39-4f51-9822-5d60a6b53ba8 tempest-TaggedBootDevicesTest-1238402254 None] attachment_update completed successfully.
Sep 24 17:44:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=20,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:44:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=25,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:45:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.092s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.344s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:45:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:45:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-78e7b13d-43c8-4ff8-ab4b-bec385d48efc req-b7e237c4-fad2-44f3-9dd1-1c17c0fd72b5 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:45:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-78e7b13d-43c8-4ff8-ab4b-bec385d48efc req-b7e237c4-fad2-44f3-9dd1-1c17c0fd72b5 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:45:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-78e7b13d-43c8-4ff8-ab4b-bec385d48efc req-b7e237c4-fad2-44f3-9dd1-1c17c0fd72b5 tempest-AttachVolumeShelveTestJSON-1216312989 None] Terminate volume connection completed successfully.
Sep 24 17:45:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-78e7b13d-43c8-4ff8-ab4b-bec385d48efc req-b7e237c4-fad2-44f3-9dd1-1c17c0fd72b5 tempest-AttachVolumeShelveTestJSON-1216312989 None] Deleting attachment bae88021-0365-4f6e-83a0-33b082070eaa. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:45:43 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:45:44 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:46:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Flow 'volume_create_manager' (05f3af7c-8603-4ac6-8941-cdb6534784b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ed701c-74bd-43d9-8aa8-964c008d9428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ed701c-74bd-43d9-8aa8-964c008d9428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-830470816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f84c28b-3441-4ba3-accb-4b29f4aa1e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac7625e33df498a844fa0354bf12e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:46:10Z,use_quota=True,user_id='7c814e1fa97e4bba9ac49f70f085afdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fded78-f7dc-4f52-b0db-b0feae92ffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fded78-f7dc-4f52-b0db-b0feae92ffac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226dcc82-f9d2-49e3-8b85-ea88cbdf6314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226dcc82-f9d2-49e3-8b85-ea88cbdf6314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f84c28b-3441-4ba3-accb-4b29f4aa1e4d', 'volume_name': 'volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad72369-cd87-4376-ac18-6cd7fc63bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad72369-cd87-4376-ac18-6cd7fc63bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90830a73-c9fd-4937-a679-5429dc2dfa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Volume 0f84c28b-3441-4ba3-accb-4b29f4aa1e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d', 'volume_size': 1}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-830470816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f84c28b-3441-4ba3-accb-4b29f4aa1e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ac7625e33df498a844fa0354bf12e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:46:10Z,use_quota=True,user_id='7c814e1fa97e4bba9ac49f70f085afdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Creating volume 0f84c28b-3441-4ba3-accb-4b29f4aa1e4d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:46:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:46:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:46:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:46:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:46:11 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:46:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:11 devstack quobyte-client[84528]: System call of process 88557 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:46:11 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=11, name=volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:46:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d 1073741824" returned: 0 in 1.630s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" returned: 0 in 0.290s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] <== create_volume: return (2137ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90830a73-c9fd-4937-a679-5429dc2dfa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366ab394-7701-4edf-a95c-9a2b35b93799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:46:13 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Volume volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d (0f84c28b-3441-4ba3-accb-4b29f4aa1e4d): created successfully
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (366ab394-7701-4edf-a95c-9a2b35b93799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:46:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Flow 'volume_create_manager' (05f3af7c-8603-4ac6-8941-cdb6534784b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:46:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ac0f529b-cce7-48c9-b8f1-e20fab4335c7 tempest-DeleteServersTestJSON-792889237 None] Created volume successfully.
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.340s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:46:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:46:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:46:20 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8694d-2405-4225-bc24-7fb9db721384]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:46:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:22 devstack quobyte-client[84528]: System call of process 88590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:46:22 devstack quobyte-client[84528]: System call of process 88590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:46:22 devstack quobyte-client[84528]: System call of process 88590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:46:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" returned: 0 in 1.359s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.569s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:46:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cadd56e-36e4-4091-90f1-e2a891a9bb0b', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:46:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:46:23 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-3acd9e1b-7ad3-4910-ba7d-98b9de0af0c6 req-ab5cfa52-d0ba-486b-b4bb-9708e8075744 tempest-DeleteServersTestJSON-792889237 None] attachment_update completed successfully.
Sep 24 17:46:33 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:46:33 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:46:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-8b72b200-cd0e-4a81-a086-562850240c9c req-ca5ba689-4522-44d1-8d90-2f0f4e16cc35 tempest-DeleteServersTestJSON-792889237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:46:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-8b72b200-cd0e-4a81-a086-562850240c9c req-ca5ba689-4522-44d1-8d90-2f0f4e16cc35 tempest-DeleteServersTestJSON-792889237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:46:37 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-8b72b200-cd0e-4a81-a086-562850240c9c req-ca5ba689-4522-44d1-8d90-2f0f4e16cc35 tempest-DeleteServersTestJSON-792889237 None] Terminate volume connection completed successfully.
Sep 24 17:46:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-8b72b200-cd0e-4a81-a086-562850240c9c req-ca5ba689-4522-44d1-8d90-2f0f4e16cc35 tempest-DeleteServersTestJSON-792889237 None] Deleting attachment 0cadd56e-36e4-4091-90f1-e2a891a9bb0b. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "cinder-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "cinder-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:46:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "cinder-quobyte-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "cinder-quobyte-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" acquired by "delete_volume" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5855d0-d3ab-4288-8939-18c61fc15fb5]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:46:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" returned: 0 in 0.497s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" returned: 0 in 0.113s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "cinder-quobyte-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d" released by "delete_volume" :: held 0.775s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:46:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Created reservations ['0f68729e-54b9-46a2-aa3e-5f2deb876788', '8ba921be-d992-40e2-bf5d-0d04d477d7c9', '848ee9cf-971c-4235-ada6-51b1a7851585', 'b8a54ec0-57a1-4a85-b419-ed3c4d916da3'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.112s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:46:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Deleted volume successfully.
Sep 24 17:46:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b8d89820-ccad-421f-8292-60bab2a7e521 tempest-DeleteServersTestJSON-792889237 None] Lock "cinder-0f84c28b-3441-4ba3-accb-4b29f4aa1e4d-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:47:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=4,cinder:UPDATE=12 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.439s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:47:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-302b0fd7-90e5-4998-8f6a-b2645063788a tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-302b0fd7-90e5-4998-8f6a-b2645063788a tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-302b0fd7-90e5-4998-8f6a-b2645063788a tempest-TaggedBootDevicesTest-1238402254 None] Terminate volume connection completed successfully.
Sep 24 17:47:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-302b0fd7-90e5-4998-8f6a-b2645063788a tempest-TaggedBootDevicesTest-1238402254 None] Deleting attachment ac6bc9fc-5f0b-4da8-85b9-4fd1dbb14ebb. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:47:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-5d55d0a3-5d94-413d-98a8-bda2a01cb539 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-5d55d0a3-5d94-413d-98a8-bda2a01cb539 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-5d55d0a3-5d94-413d-98a8-bda2a01cb539 tempest-TaggedBootDevicesTest-1238402254 None] Terminate volume connection completed successfully.
Sep 24 17:47:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-5d55d0a3-5d94-413d-98a8-bda2a01cb539 tempest-TaggedBootDevicesTest-1238402254 None] Deleting attachment 8c2126e1-71a3-47aa-85b4-b78e2dc7aa0a. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:47:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-490c0d1d-be3d-4782-b718-5a08a42554b7 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-490c0d1d-be3d-4782-b718-5a08a42554b7 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-490c0d1d-be3d-4782-b718-5a08a42554b7 tempest-TaggedBootDevicesTest-1238402254 None] Terminate volume connection completed successfully.
Sep 24 17:47:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-e599eae4-082f-4359-a954-19ed0f1f4de3 req-490c0d1d-be3d-4782-b718-5a08a42554b7 tempest-TaggedBootDevicesTest-1238402254 None] Deleting attachment 549535a4-8ad4-481d-93a0-da82ce7d5ab9. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:47:42 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:47:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Flow 'volume_create_manager' (e9ed6595-bad7-4279-a6ce-964e817d483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f732bccb-c621-4e54-b0e0-15a1bd5c0f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f732bccb-c621-4e54-b0e0-15a1bd5c0f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-114215721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0a6c96-b003-4322-a92f-319fb1e4e658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b825436f7e471688bb3d85ccd05f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:47:43Z,use_quota=True,user_id='c44cf03d61c3413db432490f88935e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c5cbe1-7b52-4f39-b1d9-eacebbc5f3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c5cbe1-7b52-4f39-b1d9-eacebbc5f3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520de983-98f9-4751-8c10-d367b52fbcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520de983-98f9-4751-8c10-d367b52fbcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0a6c96-b003-4322-a92f-319fb1e4e658', 'volume_name': 'volume-5d0a6c96-b003-4322-a92f-319fb1e4e658', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4610691-a8ad-4880-b389-7780f7264910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4610691-a8ad-4880-b389-7780f7264910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e139759-d46d-492f-ae6d-ad9234a5fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:43 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Volume 5d0a6c96-b003-4322-a92f-319fb1e4e658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0a6c96-b003-4322-a92f-319fb1e4e658', 'volume_size': 1}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-114215721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0a6c96-b003-4322-a92f-319fb1e4e658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b825436f7e471688bb3d85ccd05f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:47:43Z,use_quota=True,user_id='c44cf03d61c3413db432490f88935e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Creating volume 5d0a6c96-b003-4322-a92f-319fb1e4e658 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:47:43 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:47:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:44 devstack quobyte-client[84528]: System call of process 89224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:47:44 devstack quobyte-client[84528]: System call of process 89224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:47:44 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=12, name=volume-5d0a6c96-b003-4322-a92f-319fb1e4e658, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:47:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 1073741824" returned: 0 in 0.957s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-41a32d5d-2032-4434-a225-a63298cf74fe-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658" returned: 0 in 0.544s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] <== create_volume: return (1721ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Flow 'volume_create_manager' (826f5f3f-e0d9-4afa-a066-80840b3d8968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2e254b-92fa-4dea-a4ef-fa9e8c6324a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2e254b-92fa-4dea-a4ef-fa9e8c6324a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375968013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe09320-e5fc-40d5-b9f1-0796f467960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732272111ed04dc1bc477c7ed1921c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:47:45Z,use_quota=True,user_id='93dc730bdd5148e19f7307827fc5e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e26331a-0be0-4407-a42f-74bae52ce377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e26331a-0be0-4407-a42f-74bae52ce377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0da2ff-3a37-4560-84de-846b33266022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0da2ff-3a37-4560-84de-846b33266022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfe09320-e5fc-40d5-b9f1-0796f467960b', 'volume_name': 'volume-cfe09320-e5fc-40d5-b9f1-0796f467960b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9848cef4-1b79-4ea0-a2af-0369d5eb8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9848cef4-1b79-4ea0-a2af-0369d5eb8c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab433c8b-bb4c-45fd-a435-74a02b7fba96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:45 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume cfe09320-e5fc-40d5-b9f1-0796f467960b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfe09320-e5fc-40d5-b9f1-0796f467960b', 'volume_size': 1}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-375968013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe09320-e5fc-40d5-b9f1-0796f467960b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='732272111ed04dc1bc477c7ed1921c69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:47:45Z,use_quota=True,user_id='93dc730bdd5148e19f7307827fc5e991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Creating volume cfe09320-e5fc-40d5-b9f1-0796f467960b {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:47:45 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:47:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:46 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=13, name=volume-cfe09320-e5fc-40d5-b9f1-0796f467960b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-41a32d5d-2032-4434-a225-a63298cf74fe-delete_volume" acquired by "delete_volume" :: waited 0.574s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e139759-d46d-492f-ae6d-ad9234a5fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0a6c96-b003-4322-a92f-319fb1e4e658', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fff0fad-5761-40de-86d0-3d8e33424b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Volume volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 (5d0a6c96-b003-4322-a92f-319fb1e4e658): created successfully
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fff0fad-5761-40de-86d0-3d8e33424b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Flow 'volume_create_manager' (e9ed6595-bad7-4279-a6ce-964e817d483c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b 1073741824" returned: 0 in 0.510s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ec8f5719-a2c2-48a4-95e4-88730ab161ca tempest-TaggedAttachmentsTest-607834690 None] Created volume successfully.
Sep 24 17:47:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-quobyte-41a32d5d-2032-4434-a225-a63298cf74fe" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b" returned: 0 in 0.540s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] <== create_volume: return (1100ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:47:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-41a32d5d-2032-4434-a225-a63298cf74fe" acquired by "delete_volume" :: waited 0.135s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab433c8b-bb4c-45fd-a435-74a02b7fba96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe09320-e5fc-40d5-b9f1-0796f467960b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44be76b9-d2db-448f-a0c1-8946264b8f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1780519b-3a64-4ef2-9d65-8bf57d86d7cc]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume volume-cfe09320-e5fc-40d5-b9f1-0796f467960b (cfe09320-e5fc-40d5-b9f1-0796f467960b): created successfully
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44be76b9-d2db-448f-a0c1-8946264b8f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:47:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Flow 'volume_create_manager' (826f5f3f-e0d9-4afa-a066-80840b3d8968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:47:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ea63bf73-d45f-4172-918e-a4a9823c29f9 tempest-AttachVolumeShelveTestJSON-1216312989 None] Created volume successfully.
Sep 24 17:47:48 devstack quobyte-client[84528]: System call of process 89233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:47:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe" returned: 0 in 1.054s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41a32d5d-2032-4434-a225-a63298cf74fe" returned: 0 in 0.207s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-41a32d5d-2032-4434-a225-a63298cf74fe" released by "delete_volume" :: held 1.516s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:48 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Created reservations ['e6ed27a5-0fbb-4ef5-b468-5e6c88d6ab46', 'c4d1cf9a-f8e5-48e5-8eca-ff9a09f1ea91', '85cbf8eb-a90b-4c6a-83bd-e67bed9151fd', '8f6a04ab-6d9d-4c80-a08a-df8e340ce64a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.172s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:47:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Deleted volume successfully.
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-18fcaef3-6114-4823-ab2a-c5bc72417e43-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a7814e6-643a-4236-8df7-2a18159f9cda tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-41a32d5d-2032-4434-a225-a63298cf74fe-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-18fcaef3-6114-4823-ab2a-c5bc72417e43-delete_volume" acquired by "delete_volume" :: waited 0.192s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-quobyte-18fcaef3-6114-4823-ab2a-c5bc72417e43" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-18fcaef3-6114-4823-ab2a-c5bc72417e43" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac755174-fb21-4dde-b532-8b7b196f6d4e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:47:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43" returned: 0 in 0.685s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18fcaef3-6114-4823-ab2a-c5bc72417e43" returned: 0 in 0.139s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-18fcaef3-6114-4823-ab2a-c5bc72417e43" released by "delete_volume" :: held 1.026s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Created reservations ['8fb80b64-e774-43ca-9641-68e92c6e8d0c', '28d4b4d6-c861-46c3-ac26-5af5897dbaa4', '440bf22c-5403-4453-81ed-3accb8a10f03', '019f37f5-6469-43c2-a9e4-b23d6da702ec'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:47:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Deleted volume successfully.
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-d4295f0b-b429-446a-bd20-51e69e6a23fb-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b7ee2ded-3430-4bd3-a0fc-3c465fccf505 tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-18fcaef3-6114-4823-ab2a-c5bc72417e43-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-d4295f0b-b429-446a-bd20-51e69e6a23fb-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "cinder-quobyte-d4295f0b-b429-446a-bd20-51e69e6a23fb" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-d4295f0b-b429-446a-bd20-51e69e6a23fb" acquired by "delete_volume" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[912ada90-59e2-441e-ab29-60e92bfb99b5]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:47:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:54 devstack quobyte-client[84528]: System call of process 89249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:47:54 devstack quobyte-client[84528]: System call of process 89249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:47:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 1.804s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 1 in 1.134s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:47:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d4295f0b-b429-446a-bd20-51e69e6a23fb" returned: 0 in 0.208s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-quobyte-d4295f0b-b429-446a-bd20-51e69e6a23fb" released by "delete_volume" :: held 3.698s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:47:56 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Created reservations ['edda3786-3d6e-42c1-840d-08a40bc627dd', 'e8143fbd-5361-4ac4-a171-38023672d922', '9309edb1-b31d-4d2e-b135-07c35ae6e6e2', '8fa3a617-0e9c-45af-9ec3-71dd5edeb294'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.243s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:47:57 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:47:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Deleted volume successfully.
Sep 24 17:47:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-47f09ff4-5c8d-437d-9d6e-c81e29160a4d tempest-TaggedBootDevicesTest-1238402254 None] Lock "cinder-d4295f0b-b429-446a-bd20-51e69e6a23fb-delete_volume" released by "delete_volume" :: held 5.646s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:48:07 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=32,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:48:07 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-b49a9529-6fe4-406b-b3be-d2315e2b8c68 req-a13ce460-6d8d-4963-9d5c-f85b1aed8fb7 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-b49a9529-6fe4-406b-b3be-d2315e2b8c68 req-a13ce460-6d8d-4963-9d5c-f85b1aed8fb7 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-b49a9529-6fe4-406b-b3be-d2315e2b8c68 req-a13ce460-6d8d-4963-9d5c-f85b1aed8fb7 tempest-AttachVolumeShelveTestJSON-1216312989 None] No connector for attachment 8c62d4cd-cf16-4e3f-a320-ff2436b28f4d; skipping storage backend terminate_connection call. {{(pid=84502) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-b49a9529-6fe4-406b-b3be-d2315e2b8c68 req-a13ce460-6d8d-4963-9d5c-f85b1aed8fb7 tempest-AttachVolumeShelveTestJSON-1216312989 None] Deleting attachment 8c62d4cd-cf16-4e3f-a320-ff2436b28f4d. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.585s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:48:26 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:48:26 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:48:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-26889f80-b8f9-415f-a97f-81ddb6310a1f tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-26889f80-b8f9-415f-a97f-81ddb6310a1f tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-1246526329: creating
Sep 24 17:48:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-26889f80-b8f9-415f-a97f-81ddb6310a1f tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-1246526329: created successfully
Sep 24 17:48:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-26889f80-b8f9-415f-a97f-81ddb6310a1f tempest-GroupSnapshotsTest-1981500661 None] Create group completed successfully.
Sep 24 17:48:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:48:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (6d14f5c2-868e-40ad-a049-a55a5cc53305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdfc52c-141d-4d87-a8ba-47ee3591c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdfc52c-141d-4d87-a8ba-47ee3591c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160525520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=35db222e-e2ff-4fa1-bd53-0f4eeebdd29e,host='devstack@QuobyteHD#QuobyteHD',id=cccf2c87-da1e-44af-8a4a-4b2970300977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:48:35Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0f567-1050-4d96-989f-f918dab82961),volume_type_id=4fc0f567-1050-4d96-989f-f918dab82961)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7d65c7-9501-4333-82e0-93226acf316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7d65c7-9501-4333-82e0-93226acf316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281cea95-00cc-455c-a99a-8b1c4f86298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (281cea95-00cc-455c-a99a-8b1c4f86298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cccf2c87-da1e-44af-8a4a-4b2970300977', 'volume_name': 'volume-cccf2c87-da1e-44af-8a4a-4b2970300977', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0131b46c-cb2b-47af-9d5d-3974e39b8a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0131b46c-cb2b-47af-9d5d-3974e39b8a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f065d1-7b94-4fdc-b990-944e5591657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:35 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Volume cccf2c87-da1e-44af-8a4a-4b2970300977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cccf2c87-da1e-44af-8a4a-4b2970300977', 'volume_size': 1}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=35db222e-e2ff-4fa1-bd53-0f4eeebdd29e,created_at=2025-09-24T15:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-160525520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=35db222e-e2ff-4fa1-bd53-0f4eeebdd29e,host='devstack@QuobyteHD#QuobyteHD',id=cccf2c87-da1e-44af-8a4a-4b2970300977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:48:35Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fc0f567-1050-4d96-989f-f918dab82961),volume_type_id=4fc0f567-1050-4d96-989f-f918dab82961)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Creating volume cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:48:35 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:35 devstack quobyte-client[84528]: System call of process 89524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:35 devstack quobyte-client[84528]: System call of process 89524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:35 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=14, name=volume-cccf2c87-da1e-44af-8a4a-4b2970300977, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 1073741824" returned: 0 in 0.501s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 0.381s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] <== create_volume: return (1008ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f065d1-7b94-4fdc-b990-944e5591657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cccf2c87-da1e-44af-8a4a-4b2970300977', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c11dc3-fc9f-4a35-8ff9-b5b38951e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:48:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Volume volume-cccf2c87-da1e-44af-8a4a-4b2970300977 (cccf2c87-da1e-44af-8a4a-4b2970300977): created successfully
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c11dc3-fc9f-4a35-8ff9-b5b38951e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:48:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (6d14f5c2-868e-40ad-a049-a55a5cc53305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:48:37 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-186174aa-398b-4f77-9309-611319fd0769 tempest-GroupSnapshotsTest-1981500661 None] Created volume successfully.
Sep 24 17:48:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] GroupSnapshot 11117878-5b4b-432c-b049-1a2198bf27a8: creating.
Sep 24 17:48:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Group snapshot 11117878-5b4b-432c-b049-1a2198bf27a8: creating. {{(pid=84502) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Creating offline snapshot 2ffddc1f-336c-46f8-8788-53dcb00b63e1 of volume cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab48e3-71ad-4c41-a61b-6662cb51946c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:48:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:40 devstack quobyte-client[84528]: System call of process 89542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 1.011s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:40 devstack quobyte-client[84528]: System call of process 89550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:40 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=15, name=volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:48:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 1G" returned: 0 in 0.435s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cccf2c87-da1e-44af-8a4a-4b2970300977 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:41 devstack quobyte-client[84528]: System call of process 89553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:41 devstack quobyte-client[84528]: System call of process 89553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img rebase -u -b volume-cccf2c87-da1e-44af-8a4a-4b2970300977 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.300s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.227s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.info" returned: 0 in 0.229s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:48:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.info" returned: 0 in 0.141s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.993s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-273d4801-1f99-4478-9e08-f2ad4284642e tempest-GroupSnapshotsTest-1981500661 None] group_snapshot 11117878-5b4b-432c-b049-1a2198bf27a8: created successfully
Sep 24 17:48:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1-95d12a95-748f-460b-a3e9-5b518e285bf2" by "_create_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1-95d12a95-748f-460b-a3e9-5b518e285bf2" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Creating volume 95d12a95-748f-460b-a3e9-5b518e285bf2 from snapshot 2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:48:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" by "_copy_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] snapshot: 2ffddc1f-336c-46f8-8788-53dcb00b63e1, volume: 95d12a95-748f-460b-a3e9-5b518e285bf2,  {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9dcc6-7478-4e67-a68c-8d4e6b20d5af]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:48:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:47 devstack quobyte-client[84528]: System call of process 89574 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 1.162s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cccf2c87-da1e-44af-8a4a-4b2970300977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Creating direct copy from snapshot {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea107dc-b5b7-4573-a004-d418b558f893]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:48:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:48 devstack quobyte-client[84528]: System call of process 89577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:48 devstack quobyte-client[84528]: System call of process 89577 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 0.562s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:48 devstack cinder-volume[84502]: DEBUG cinder.utils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 not found in is_blk_device check {{(pid=84502) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 17:48:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:48 devstack quobyte-client[84528]: System call of process 89580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:48 devstack quobyte-client[84528]: System call of process 89580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:48:48 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=17, name=volume-95d12a95-748f-460b-a3e9-5b518e285bf2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:48:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2" returned: 0 in 9.664s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc42ff2-a8cb-411b-a75c-257d64bd7f9d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:48:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 1.272s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:48:59 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Converted 1024.00 MB image at 105.45 MB/s
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2" returned: 0 in 0.217s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" released by "_copy_volume_from_snapshot" :: held 13.793s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1-95d12a95-748f-460b-a3e9-5b518e285bf2" released by "_create_volume_from_snapshot" :: held 13.894s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:48:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-034c4e57-3c10-4b62-82a4-4b837ca36dd9 tempest-GroupSnapshotsTest-1981500661 None] Create group from source-snapshot-11117878-5b4b-432c-b049-1a2198bf27a8 completed successfully.
Sep 24 17:49:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:02 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e841236a-d991-498b-afc5-8889cd688046]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:03 devstack quobyte-client[84528]: System call of process 89679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:03 devstack quobyte-client[84528]: System call of process 89679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2" returned: 0 in 1.045s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-95d12a95-748f-460b-a3e9-5b518e285bf2" returned: 0 in 0.744s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-95d12a95-748f-460b-a3e9-5b518e285bf2" released by "delete_volume" :: held 2.828s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:07 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['2024ca47-4763-481d-b5ea-d3ce2dd550cd'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:07 devstack cinder-volume[84502]: WARNING cinder.quota [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-613666699 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-613666699, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:07 devstack cinder-volume[84502]: WARNING cinder.quota [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-613666699 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-613666699, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:07 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['4dc7ed17-f661-4f15-ba3e-d6e7534d4215', 'f265c6e0-91ce-45da-9075-918d54110890', '89729561-9b3d-431b-857f-a1cbf91c00f9', '2e3fc2a4-3e1f-4fb1-a694-89687e9a1ccd'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.289s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:08 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:49:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] group_snapshot 11117878-5b4b-432c-b049-1a2198bf27a8: deleting
Sep 24 17:49:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-68dc9f2b-a3b8-4d62-8a33-8d53e4e81a0a tempest-GroupSnapshotsTest-1981500661 None] Delete group completed successfully.
Sep 24 17:49:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] group_snapshot 11117878-5b4b-432c-b049-1a2198bf27a8: deleting {{(pid=84502) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" acquired by "delete_snapshot" :: waited 0.107s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Deleting offline snapshot 2ffddc1f-336c-46f8-8788-53dcb00b63e1 of volume cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:49:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] snapshot_file for this snap is: volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:49:10 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff8b73-4282-4e88-80bb-7a771376f838]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:10 devstack quobyte-client[84528]: System call of process 89773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.922s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cccf2c87-da1e-44af-8a4a-4b2970300977(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:49:11 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4862ce8-4be6-4d5c-8a7f-5b4f5966bf44]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:11 devstack quobyte-client[84528]: System call of process 89782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 0.744s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.561s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977.2ffddc1f-336c-46f8-8788-53dcb00b63e1" returned: 0 in 0.201s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2ffddc1f-336c-46f8-8788-53dcb00b63e1" released by "_delete_snapshot" :: held 3.267s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" released by "delete_snapshot" :: held 3.340s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:13 devstack cinder-volume[84502]: WARNING cinder.quota [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-613666699 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-613666699, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:13 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['941e2448-64a4-4502-9b13-4389a4ff89fb', 'a7101153-f966-4384-92eb-c830fda8881c', 'eedf6c94-911e-4f61-80bd-c04649a8bc16', '37c52e00-d652-4222-9298-a228b85e42d8'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-005f5030-527d-40fa-9dbf-d29c04e381fe tempest-GroupSnapshotsTest-1981500661 None] group_snapshot 11117878-5b4b-432c-b049-1a2198bf27a8: deleted successfully
Sep 24 17:49:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" acquired by "delete_volume" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a44086-d3d8-4f7d-8e06-1bbc21d993c8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:15 devstack quobyte-client[84528]: System call of process 89792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:15 devstack quobyte-client[84528]: System call of process 89792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 0.501s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cccf2c87-da1e-44af-8a4a-4b2970300977" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-cccf2c87-da1e-44af-8a4a-4b2970300977" released by "delete_volume" :: held 0.819s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.204s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['f76ed414-95a0-44ca-bb76-1f97c99837aa'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:16 devstack cinder-volume[84502]: WARNING cinder.db.sqlalchemy.api [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-613666699']
Sep 24 17:49:16 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['316acdb5-4b26-40ad-9e4a-9a0f763f5db1', '97693bde-b8c7-49b5-b673-c78a6f5a313b', 'd95dc3de-48a5-4a6b-9dee-a733af6d2289', '6a24803c-71ff-456e-adbd-abf238f8df9d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.211s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:49:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6be3aeec-0321-4163-9fd1-97805af18ebd tempest-GroupSnapshotsTest-1981500661 None] Delete group completed successfully.
Sep 24 17:49:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-dec9e41d-934a-4184-9d12-4f0da0c89006 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dec9e41d-934a-4184-9d12-4f0da0c89006 tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-9206713: creating
Sep 24 17:49:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dec9e41d-934a-4184-9d12-4f0da0c89006 tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-9206713: created successfully
Sep 24 17:49:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dec9e41d-934a-4184-9d12-4f0da0c89006 tempest-GroupSnapshotsTest-1981500661 None] Create group completed successfully.
Sep 24 17:49:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (e5cd95b2-7a71-4ee4-a407-d2d2c9f4d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a5c20-1526-4725-9e15-fa7232913707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f99a5c20-1526-4725-9e15-fa7232913707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863560304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5850b47-6a64-4f24-b969-34e48974c326,host='devstack@QuobyteHD#QuobyteHD',id=0aa09337-a18f-43b9-bcc8-64e694c54529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:20Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6074f3b-da87-490d-9a17-7b92e21ffe12),volume_type_id=c6074f3b-da87-490d-9a17-7b92e21ffe12)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada4bee8-36e1-4dc0-ad56-391a2b5b8f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada4bee8-36e1-4dc0-ad56-391a2b5b8f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e7bb34-91fa-430b-b084-892c39c56f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e7bb34-91fa-430b-b084-892c39c56f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa09337-a18f-43b9-bcc8-64e694c54529', 'volume_name': 'volume-0aa09337-a18f-43b9-bcc8-64e694c54529', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec520c07-1b27-45ae-add6-c158f4faac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec520c07-1b27-45ae-add6-c158f4faac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a10f1f-212e-47a4-a5ee-3d32bb79209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:20 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Volume 0aa09337-a18f-43b9-bcc8-64e694c54529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa09337-a18f-43b9-bcc8-64e694c54529', 'volume_size': 1}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d5850b47-6a64-4f24-b969-34e48974c326,created_at=2025-09-24T15:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-863560304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5850b47-6a64-4f24-b969-34e48974c326,host='devstack@QuobyteHD#QuobyteHD',id=0aa09337-a18f-43b9-bcc8-64e694c54529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:20Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6074f3b-da87-490d-9a17-7b92e21ffe12),volume_type_id=c6074f3b-da87-490d-9a17-7b92e21ffe12)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Creating volume 0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:49:20 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:20 devstack quobyte-client[84528]: System call of process 89802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:20 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=18, name=volume-0aa09337-a18f-43b9-bcc8-64e694c54529, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 1073741824" returned: 0 in 0.365s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529" returned: 0 in 0.115s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a10f1f-212e-47a4-a5ee-3d32bb79209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa09337-a18f-43b9-bcc8-64e694c54529', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371e8bf6-6d72-4389-b805-65d23c0d94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:20 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Volume volume-0aa09337-a18f-43b9-bcc8-64e694c54529 (0aa09337-a18f-43b9-bcc8-64e694c54529): created successfully
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371e8bf6-6d72-4389-b805-65d23c0d94b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (e5cd95b2-7a71-4ee4-a407-d2d2c9f4d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fd4cb872-528a-4e32-8489-7c281c60a883 tempest-GroupSnapshotsTest-1981500661 None] Created volume successfully.
Sep 24 17:49:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (6107c5e6-6800-4681-bd8c-aab0aea014c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277caa19-7bd5-40e9-bd85-71518041a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (277caa19-7bd5-40e9-bd85-71518041a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515651215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5850b47-6a64-4f24-b969-34e48974c326,host='devstack@QuobyteHD#QuobyteHD',id=0b09f310-be72-4bcc-aa18-24acbae776f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:23Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6074f3b-da87-490d-9a17-7b92e21ffe12),volume_type_id=c6074f3b-da87-490d-9a17-7b92e21ffe12)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b617ec04-744c-4f3a-857b-448accda5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b617ec04-744c-4f3a-857b-448accda5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afa9e40-2c69-40a6-be3e-1339bb2e4b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5afa9e40-2c69-40a6-be3e-1339bb2e4b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b09f310-be72-4bcc-aa18-24acbae776f0', 'volume_name': 'volume-0b09f310-be72-4bcc-aa18-24acbae776f0', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af423d50-4e4b-4793-a683-77a112e468cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af423d50-4e4b-4793-a683-77a112e468cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4244364a-addb-42e0-8944-5e02bf897c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:22 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Volume 0b09f310-be72-4bcc-aa18-24acbae776f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b09f310-be72-4bcc-aa18-24acbae776f0', 'volume_size': 1}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d5850b47-6a64-4f24-b969-34e48974c326,created_at=2025-09-24T15:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-515651215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d5850b47-6a64-4f24-b969-34e48974c326,host='devstack@QuobyteHD#QuobyteHD',id=0b09f310-be72-4bcc-aa18-24acbae776f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:23Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6074f3b-da87-490d-9a17-7b92e21ffe12),volume_type_id=c6074f3b-da87-490d-9a17-7b92e21ffe12)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Creating volume 0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:49:22 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:23 devstack quobyte-client[84528]: System call of process 89807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:23 devstack quobyte-client[84528]: System call of process 89807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:23 devstack quobyte-client[84528]: System call of process 89807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:23 devstack quobyte-client[84528]: System call of process 89807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:23 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=19, name=volume-0b09f310-be72-4bcc-aa18-24acbae776f0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 1073741824" returned: 0 in 0.449s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:49:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.653s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4244364a-addb-42e0-8944-5e02bf897c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b09f310-be72-4bcc-aa18-24acbae776f0', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d0160b-d3de-4851-bc29-24f135a30e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:24 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Volume volume-0b09f310-be72-4bcc-aa18-24acbae776f0 (0b09f310-be72-4bcc-aa18-24acbae776f0): created successfully
Sep 24 17:49:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d0160b-d3de-4851-bc29-24f135a30e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (6107c5e6-6800-4681-bd8c-aab0aea014c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:24 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-eb6a4eff-b4fc-4284-bea9-f681a4c62e34 tempest-GroupSnapshotsTest-1981500661 None] Created volume successfully.
Sep 24 17:49:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-520c3e2e-7c7f-4eb1-b6c9-5ce75a9655e8 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-520c3e2e-7c7f-4eb1-b6c9-5ce75a9655e8 tempest-GroupSnapshotsTest-1981500661 None] Update group completed successfully.
Sep 24 17:49:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-34a142ce-2187-42ea-8ba1-953e9e3e642a tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-34a142ce-2187-42ea-8ba1-953e9e3e642a tempest-GroupSnapshotsTest-1981500661 None] Update group completed successfully.
Sep 24 17:49:27 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=49,cinder:UPDATE=47,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:49:27 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=44,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=8 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:49:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-df030c6f-dd6c-4755-82e3-6a7cd9113c60 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-df030c6f-dd6c-4755-82e3-6a7cd9113c60 tempest-GroupSnapshotsTest-1981500661 None] Update group completed successfully.
Sep 24 17:49:28 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9ccea578-cb87-48fb-acf0-2e003370ca8c tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9ccea578-cb87-48fb-acf0-2e003370ca8c tempest-GroupSnapshotsTest-1981500661 None] Update group completed successfully.
Sep 24 17:49:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] GroupSnapshot bb4a1336-3f77-44b0-962f-83d64f15622d: creating.
Sep 24 17:49:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Group snapshot bb4a1336-3f77-44b0-962f-83d64f15622d: creating. {{(pid=84502) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Creating offline snapshot 1fae9501-e5cc-4b68-acca-c5346730c2b1 of volume 0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[af30c07f-379a-4951-93d8-569c798694be]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0" returned: 0 in 0.505s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:31 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=20, name=volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 1G" returned: 0 in 0.294s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b09f310-be72-4bcc-aa18-24acbae776f0 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:31 devstack quobyte-client[84528]: System call of process 89818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img rebase -u -b volume-0b09f310-be72-4bcc-aa18-24acbae776f0 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.232s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.107s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.186s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.info" returned: 0 in 0.115s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.info" returned: 0 in 0.110s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Creating offline snapshot 36f19644-ead3-467d-8aa5-b6c1f3117cc4 of volume 0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2fa91-e3e1-4af5-9030-860880034354]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:33 devstack quobyte-client[84528]: System call of process 89825 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529" returned: 0 in 0.467s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:33 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=22, name=volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 1G" returned: 0 in 0.271s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0aa09337-a18f-43b9-bcc8-64e694c54529 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img rebase -u -b volume-0aa09337-a18f-43b9-bcc8-64e694c54529 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.154s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.112s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.131s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.info" returned: 0 in 0.160s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.info" returned: 0 in 0.134s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:35 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-790d1555-691f-4048-a180-eb8dbdf31684 tempest-GroupSnapshotsTest-1981500661 None] group_snapshot bb4a1336-3f77-44b0-962f-83d64f15622d: created successfully
Sep 24 17:49:35 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] group_snapshot bb4a1336-3f77-44b0-962f-83d64f15622d: deleting
Sep 24 17:49:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] group_snapshot bb4a1336-3f77-44b0-962f-83d64f15622d: deleting {{(pid=84502) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 17:49:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" acquired by "delete_snapshot" :: waited 0.164s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-1fae9501-e5cc-4b68-acca-c5346730c2b1" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-1fae9501-e5cc-4b68-acca-c5346730c2b1" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Deleting offline snapshot 1fae9501-e5cc-4b68-acca-c5346730c2b1 of volume 0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] snapshot_file for this snap is: volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d43246-6f39-48ba-be0c-f0a3eec0a92e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:36 devstack quobyte-client[84528]: System call of process 89841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:36 devstack quobyte-client[84528]: System call of process 89841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:36 devstack quobyte-client[84528]: System call of process 89841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:36 devstack quobyte-client[84528]: System call of process 89841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.898s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b09f310-be72-4bcc-aa18-24acbae776f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9dfe83-4520-43e9-8585-ecbf2a41a32c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:37 devstack quobyte-client[84528]: System call of process 89844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0" returned: 0 in 0.603s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:38 devstack quobyte-client[84528]: System call of process 89848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.382s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0.1fae9501-e5cc-4b68-acca-c5346730c2b1" returned: 0 in 0.175s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-1fae9501-e5cc-4b68-acca-c5346730c2b1" released by "_delete_snapshot" :: held 2.661s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" released by "delete_snapshot" :: held 2.738s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-36f19644-ead3-467d-8aa5-b6c1f3117cc4" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-36f19644-ead3-467d-8aa5-b6c1f3117cc4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Deleting offline snapshot 36f19644-ead3-467d-8aa5-b6c1f3117cc4 of volume 0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] snapshot_file for this snap is: volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4404c525-dc44-4ed8-962f-3696cd43dbfc]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:39 devstack quobyte-client[84528]: System call of process 89852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:39 devstack quobyte-client[84528]: System call of process 89852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.650s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0aa09337-a18f-43b9-bcc8-64e694c54529(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e6d19c-d4fa-4ed9-898b-59eefeeba39d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:40 devstack quobyte-client[84528]: System call of process 89855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:40 devstack quobyte-client[84528]: System call of process 89855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:40 devstack quobyte-client[84528]: System call of process 89855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:40 devstack quobyte-client[84528]: System call of process 89855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529" returned: 0 in 0.882s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:41 devstack quobyte-client[84528]: System call of process 89860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:41 devstack quobyte-client[84528]: System call of process 89860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:41 devstack quobyte-client[84528]: System call of process 89860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:41 devstack quobyte-client[84528]: System call of process 89860 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.725s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529.36f19644-ead3-467d-8aa5-b6c1f3117cc4" returned: 0 in 0.184s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-36f19644-ead3-467d-8aa5-b6c1f3117cc4" released by "_delete_snapshot" :: held 3.213s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" released by "delete_snapshot" :: held 3.267s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:42 devstack cinder-volume[84502]: WARNING cinder.quota [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-105161202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-105161202, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:42 devstack cinder-volume[84502]: WARNING cinder.quota [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-105161202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-105161202, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:42 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['a1cdad8e-90ea-44a8-89d7-f5860b396024', '92d61ba8-881f-4a56-b15a-49c966d1ad69', 'f259ca8e-b6ed-48c0-be66-8d168389458f', '2eb9e9ad-f382-446e-83d4-db42c917fc88'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['ae8e91ef-d1fb-4148-89f5-2f8347d5e09d', '6045894c-1244-45c5-a640-6a689e853874', 'f93232cf-92aa-4d54-87c1-85cc08d1936f', '87ea1da2-6db1-4a9d-abd9-d2fb532726c8'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c20225c2-7e1e-4129-a89d-91695e7afb11 tempest-GroupSnapshotsTest-1981500661 None] group_snapshot bb4a1336-3f77-44b0-962f-83d64f15622d: deleted successfully
Sep 24 17:49:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" acquired by "delete_volume" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:44 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef04198f-3ed4-41b6-9076-b04f19f02898]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529" returned: 0 in 0.472s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0aa09337-a18f-43b9-bcc8-64e694c54529" returned: 0 in 0.139s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0aa09337-a18f-43b9-bcc8-64e694c54529" released by "delete_volume" :: held 0.792s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338ac3d-3622-4de2-94f1-05feb54d7d71]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0" returned: 0 in 0.559s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0b09f310-be72-4bcc-aa18-24acbae776f0" returned: 0 in 0.129s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-0b09f310-be72-4bcc-aa18-24acbae776f0" released by "delete_volume" :: held 0.908s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['c5b9071a-656b-4ae0-ae44-c4be76ee55a4'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:46 devstack cinder-volume[84502]: WARNING cinder.quota [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-105161202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-105161202, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:49:46 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['414abcad-fcaf-4c52-86d3-e700556930ad', 'f31bacc5-3219-4f5f-83e3-9858bbed7b0c', '8fa6c475-7ea6-455a-a86b-31f72013ccb3', '35278364-c7e0-44bd-8228-3b0d5b5d23be'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['bc75d709-9c12-4670-8e5f-e4faded3d0dd', '118e7fc7-90d7-4306-9044-fc317fc26b08', '802ee3ed-4dfe-4260-be16-634dc417d353', '6b4d9dc8-197e-40ca-9c4e-1b97a6f88442'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.412s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:48 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:49:48 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c8dbffa6-15c2-4fd1-a344-43c37f5035d5 tempest-GroupSnapshotsTest-1981500661 None] Delete group completed successfully.
Sep 24 17:49:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3e687504-1a0e-43c8-af04-e89a91fffd13 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3e687504-1a0e-43c8-af04-e89a91fffd13 tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-1084780548: creating
Sep 24 17:49:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3e687504-1a0e-43c8-af04-e89a91fffd13 tempest-GroupSnapshotsTest-1981500661 None] Group tempest-GroupSnapshotsTest-Group-1084780548: created successfully
Sep 24 17:49:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3e687504-1a0e-43c8-af04-e89a91fffd13 tempest-GroupSnapshotsTest-1981500661 None] Create group completed successfully.
Sep 24 17:49:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:51 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (2c0243a2-2104-4e9a-87fa-e8e04e833885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5bebd-e089-4267-bd42-d54831a1e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece5bebd-e089-4267-bd42-d54831a1e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-805211122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e6d93d12-dc59-4ae6-ba0c-ecd355b36324,host='devstack@QuobyteHD#QuobyteHD',id=2e5c0153-7d8d-462e-a021-f09c21688196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:52Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f8b90d-ccc1-4a02-bcca-67dc1501d791),volume_type_id=79f8b90d-ccc1-4a02-bcca-67dc1501d791)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738624dd-6d1c-41ed-9d88-58ad083129d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738624dd-6d1c-41ed-9d88-58ad083129d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891e74fd-1d08-47cb-87bc-50316c43ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891e74fd-1d08-47cb-87bc-50316c43ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5c0153-7d8d-462e-a021-f09c21688196', 'volume_name': 'volume-2e5c0153-7d8d-462e-a021-f09c21688196', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ca294e-c514-4ed9-ab6e-68a12324920b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ca294e-c514-4ed9-ab6e-68a12324920b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685d34b0-3d0c-4d02-a654-902ed0e51656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:52 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Volume 2e5c0153-7d8d-462e-a021-f09c21688196: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5c0153-7d8d-462e-a021-f09c21688196', 'volume_size': 1}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e6d93d12-dc59-4ae6-ba0c-ecd355b36324,created_at=2025-09-24T15:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-805211122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e6d93d12-dc59-4ae6-ba0c-ecd355b36324,host='devstack@QuobyteHD#QuobyteHD',id=2e5c0153-7d8d-462e-a021-f09c21688196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf8e1331844c4e26b8db14379aed0847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:49:52Z,use_quota=True,user_id='4321e14b264841edbf3ffc009462bcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79f8b90d-ccc1-4a02-bcca-67dc1501d791),volume_type_id=79f8b90d-ccc1-4a02-bcca-67dc1501d791)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Creating volume 2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:49:52 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:52 devstack quobyte-client[84528]: System call of process 89938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:52 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=24, name=volume-2e5c0153-7d8d-462e-a021-f09c21688196, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 1073741824" returned: 0 in 0.391s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196" returned: 0 in 0.080s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] <== create_volume: return (570ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:49:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685d34b0-3d0c-4d02-a654-902ed0e51656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5c0153-7d8d-462e-a021-f09c21688196', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29fd10a-c70c-4700-b30c-a68f814180bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:49:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Volume volume-2e5c0153-7d8d-462e-a021-f09c21688196 (2e5c0153-7d8d-462e-a021-f09c21688196): created successfully
Sep 24 17:49:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29fd10a-c70c-4700-b30c-a68f814180bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:49:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Flow 'volume_create_manager' (2c0243a2-2104-4e9a-87fa-e8e04e833885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:49:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-904377fe-e5aa-4a35-8a71-a1dd985ea5c7 tempest-GroupSnapshotsTest-1981500661 None] Created volume successfully.
Sep 24 17:49:54 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] GroupSnapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: creating.
Sep 24 17:49:54 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Group snapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: creating. {{(pid=84502) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Creating offline snapshot 387aa42e-08d8-4a3f-bf07-9da087028652 of volume 2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da24f9-eb54-40bf-8ba4-7ae86502143e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196" returned: 0 in 0.441s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:55 devstack quobyte-client[84528]: System call of process 89951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:55 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=25, name=volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 1G" returned: 0 in 0.334s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2e5c0153-7d8d-462e-a021-f09c21688196 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:55 devstack quobyte-client[84528]: System call of process 89959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img rebase -u -b volume-2e5c0153-7d8d-462e-a021-f09c21688196 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.202s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.129s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.180s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.info" returned: 0 in 0.478s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:49:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.info" returned: 0 in 0.240s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.242s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[071da411-3b0f-4721-ae6a-6f00d25fa665]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:49:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:49:58 devstack quobyte-client[84528]: System call of process 89969 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:49:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-82dc5ee0-0a1f-451a-819f-619094376bb4 tempest-GroupSnapshotsTest-1981500661 None] group_snapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: created successfully
Sep 24 17:49:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658" returned: 0 in 0.841s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:49:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:49:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-5d0a6c96-b003-4322-a92f-319fb1e4e658', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '758a72c0-ca03-432c-a8a7-43849f367f6d', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:49:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-54d17d77-1c59-4706-9495-5063767ad8dc req-95241e48-c4df-473c-a65a-9b08693883b2 tempest-TaggedAttachmentsTest-607834690 None] attachment_update completed successfully.
Sep 24 17:49:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] group_snapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: deleting
Sep 24 17:49:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] group_snapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: deleting {{(pid=84502) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" acquired by "delete_snapshot" :: waited 0.234s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-387aa42e-08d8-4a3f-bf07-9da087028652" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-387aa42e-08d8-4a3f-bf07-9da087028652" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:49:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Deleting offline snapshot 387aa42e-08d8-4a3f-bf07-9da087028652 of volume 2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] snapshot_file for this snap is: volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2c8427-2219-4918-8f9a-b3e60d6fcfea]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:00 devstack quobyte-client[84528]: System call of process 90022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.691s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e5c0153-7d8d-462e-a021-f09c21688196(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0ddd7-6282-48bb-965b-63f224400dae]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:01 devstack quobyte-client[84528]: System call of process 90052 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196" returned: 0 in 0.814s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.633s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196.387aa42e-08d8-4a3f-bf07-9da087028652" returned: 0 in 0.208s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-387aa42e-08d8-4a3f-bf07-9da087028652" released by "_delete_snapshot" :: held 2.986s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" released by "delete_snapshot" :: held 3.038s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:03 devstack cinder-volume[84502]: WARNING cinder.quota [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1041236914 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1041236914, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:03 devstack cinder-volume[84502]: WARNING cinder.quota [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1041236914 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1041236914, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:03 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['2228c28f-5d45-4eb4-ad7e-f3a2f345f8c9', '712eafd6-f591-4ac9-926c-7b5882bdbf67', '427f33ba-e481-4e02-93ad-39fed804b784', 'df150aee-7d8a-41a3-abc8-9f46df5eb72d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6237f0a8-4ce9-4d9b-b5c3-92a0b75e0c6f tempest-GroupSnapshotsTest-1981500661 None] group_snapshot f343b911-4a5a-42d6-81bd-7f20c2bf44c9: deleted successfully
Sep 24 17:50:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" acquired by "delete_volume" :: waited 0.037s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:04 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98ff47-fc78-4e36-b95d-ebca5e1317ec]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:05 devstack quobyte-client[84528]: System call of process 90395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196" returned: 0 in 0.684s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e5c0153-7d8d-462e-a021-f09c21688196" returned: 0 in 0.185s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Lock "cinder-quobyte-2e5c0153-7d8d-462e-a021-f09c21688196" released by "delete_volume" :: held 1.166s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['7d600513-b039-40e1-aeee-ab537a043c08'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:06 devstack cinder-volume[84502]: WARNING cinder.quota [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1041236914 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1041236914, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Created reservations ['1112682d-2de7-4f32-9711-c40a85509ef3', 'c53c08b6-1662-4268-821c-708633a285b3', '6683474c-d5f1-4418-891a-a0d5f279ee17', 'ea657ee4-9b77-4d9e-9693-1599e8595583'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.414s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:07 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-40c0bb87-1ab3-420b-a3e7-73d718eb0a06 tempest-GroupSnapshotsTest-1981500661 None] Delete group completed successfully.
Sep 24 17:50:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8765089a-e3c1-4e25-b18d-0d9da9b405f8 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8765089a-e3c1-4e25-b18d-0d9da9b405f8 tempest-GroupsTest-265254430 None] Group tempest-Group1-1785988781: creating
Sep 24 17:50:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8765089a-e3c1-4e25-b18d-0d9da9b405f8 tempest-GroupsTest-265254430 None] Group tempest-Group1-1785988781: created successfully
Sep 24 17:50:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8765089a-e3c1-4e25-b18d-0d9da9b405f8 tempest-GroupsTest-265254430 None] Create group completed successfully.
Sep 24 17:50:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8597ec56-2270-4a46-89c5-888ac4100cb3 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8597ec56-2270-4a46-89c5-888ac4100cb3 tempest-GroupsTest-265254430 None] Group tempest-Group2-912776126: creating
Sep 24 17:50:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8597ec56-2270-4a46-89c5-888ac4100cb3 tempest-GroupsTest-265254430 None] Group tempest-Group2-912776126: created successfully
Sep 24 17:50:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8597ec56-2270-4a46-89c5-888ac4100cb3 tempest-GroupsTest-265254430 None] Create group completed successfully.
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.122s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:18 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:50:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (a6a00fdb-3170-4183-b40b-70b759a96174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d131ce3f-574e-40e5-beef-054c933c8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d131ce3f-574e-40e5-beef-054c933c8c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211088698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=241b3a13-eefa-4996-a3da-6dd5664a14f2,host='devstack@QuobyteHD#QuobyteHD',id=81359dd0-50a7-47d6-a3ed-92a074a05cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:18Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8e039b-4a86-4721-bea7-039d589680d2),volume_type_id=ef8e039b-4a86-4721-bea7-039d589680d2)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f009fe9-fde1-4c03-abeb-3fe1d6a73222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f009fe9-fde1-4c03-abeb-3fe1d6a73222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed4417-f171-4b08-a549-1e291f653cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ed4417-f171-4b08-a549-1e291f653cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81359dd0-50a7-47d6-a3ed-92a074a05cdd', 'volume_name': 'volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033f0c1b-abdb-4422-b31d-99fb19248d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (033f0c1b-abdb-4422-b31d-99fb19248d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434efa3a-34e9-4d2f-bf6d-f526b071d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:19 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Volume 81359dd0-50a7-47d6-a3ed-92a074a05cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd', 'volume_size': 1}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=241b3a13-eefa-4996-a3da-6dd5664a14f2,created_at=2025-09-24T15:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211088698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=241b3a13-eefa-4996-a3da-6dd5664a14f2,host='devstack@QuobyteHD#QuobyteHD',id=81359dd0-50a7-47d6-a3ed-92a074a05cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:18Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef8e039b-4a86-4721-bea7-039d589680d2),volume_type_id=ef8e039b-4a86-4721-bea7-039d589680d2)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Creating volume 81359dd0-50a7-47d6-a3ed-92a074a05cdd {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:50:19 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:19 devstack quobyte-client[84528]: System call of process 90493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:19 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=27, name=volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd 1073741824" returned: 0 in 0.405s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd" returned: 0 in 0.107s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] <== create_volume: return (616ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.630s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434efa3a-34e9-4d2f-bf6d-f526b071d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d810a42-b0cc-444b-b1c1-0dfbdcc6831d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:20 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Volume volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd (81359dd0-50a7-47d6-a3ed-92a074a05cdd): created successfully
Sep 24 17:50:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d810a42-b0cc-444b-b1c1-0dfbdcc6831d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (a6a00fdb-3170-4183-b40b-70b759a96174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b3d56e82-a05f-477f-9d68-b7bf8b15cafe tempest-GroupsTest-265254430 None] Created volume successfully.
Sep 24 17:50:20 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Acquiring lock "cinder-quobyte-81359dd0-50a7-47d6-a3ed-92a074a05cdd" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-81359dd0-50a7-47d6-a3ed-92a074a05cdd" acquired by "delete_volume" :: waited 0.067s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:21 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbfeeef-cce4-4c2d-a467-5e6f65b9516a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:21 devstack quobyte-client[84528]: System call of process 90524 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd" returned: 0 in 0.805s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-81359dd0-50a7-47d6-a3ed-92a074a05cdd" returned: 0 in 0.215s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-81359dd0-50a7-47d6-a3ed-92a074a05cdd" released by "delete_volume" :: held 1.262s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:22 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Created reservations ['67924d59-89ef-4a0b-a8f0-faaa677ac6a2'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:22 devstack cinder-volume[84502]: WARNING cinder.quota [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-42604751 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-42604751, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:22 devstack cinder-volume[84502]: WARNING cinder.quota [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-42604751 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-42604751, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:22 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Created reservations ['07ef362f-c367-448f-971f-e4c3d565dd3b', '4fb20d27-df15-4bef-98e4-63f2919d2531', 'd0f0fc94-e2ea-43bb-8761-5e8b328347c1', '0d371e58-eb2d-4371-abe7-91d47a45e953'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.099s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:23 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7602dc52-504e-4ca0-968e-314b9c47867f tempest-GroupsTest-265254430 None] Delete group completed successfully.
Sep 24 17:50:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Created reservations ['4b15f95b-6113-45a8-bd54-1b5242acaf6d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:24 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:24 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-38010f26-d2d6-4f64-bdd2-c7fb55705d71 tempest-GroupsTest-265254430 None] Delete group completed successfully.
Sep 24 17:50:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-35c29016-7bdc-4558-9d00-02fa2581fc80 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-35c29016-7bdc-4558-9d00-02fa2581fc80 tempest-GroupsTest-265254430 None] Group tempest-GroupsTest-Group-1387216673: creating
Sep 24 17:50:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-35c29016-7bdc-4558-9d00-02fa2581fc80 tempest-GroupsTest-265254430 None] Group tempest-GroupsTest-Group-1387216673: created successfully
Sep 24 17:50:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-35c29016-7bdc-4558-9d00-02fa2581fc80 tempest-GroupsTest-265254430 None] Create group completed successfully.
Sep 24 17:50:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (687ac9da-a390-4ad9-944b-95b300fbf377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3254e4a-2848-479b-b754-ec8a8f7c8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3254e4a-2848-479b-b754-ec8a8f7c8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012853960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=667d47d1-bc03-4aa1-859e-29c3483e16df,host='devstack@QuobyteHD#QuobyteHD',id=303f7894-b312-4b75-ba5e-fcde266b4025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:27Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db41391c-d018-43b2-a3fc-272e9b09ff5c),volume_type_id=db41391c-d018-43b2-a3fc-272e9b09ff5c)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc2741-ef06-4563-8d45-33ddaf8d5dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc2741-ef06-4563-8d45-33ddaf8d5dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d1bb7c-19e9-42e8-adfc-b23da4919897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d1bb7c-19e9-42e8-adfc-b23da4919897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '303f7894-b312-4b75-ba5e-fcde266b4025', 'volume_name': 'volume-303f7894-b312-4b75-ba5e-fcde266b4025', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1f30bf-b1bb-4899-b527-f11612f47813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1f30bf-b1bb-4899-b527-f11612f47813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efc7fc3-2a6f-4305-b62a-aa0362cf4427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Volume 303f7894-b312-4b75-ba5e-fcde266b4025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-303f7894-b312-4b75-ba5e-fcde266b4025', 'volume_size': 1}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=667d47d1-bc03-4aa1-859e-29c3483e16df,created_at=2025-09-24T15:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012853960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=667d47d1-bc03-4aa1-859e-29c3483e16df,host='devstack@QuobyteHD#QuobyteHD',id=303f7894-b312-4b75-ba5e-fcde266b4025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:27Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db41391c-d018-43b2-a3fc-272e9b09ff5c),volume_type_id=db41391c-d018-43b2-a3fc-272e9b09ff5c)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Creating volume 303f7894-b312-4b75-ba5e-fcde266b4025 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:50:27 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:27 devstack quobyte-client[84528]: System call of process 90531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:27 devstack quobyte-client[84528]: System call of process 90531 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:27 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=28, name=volume-303f7894-b312-4b75-ba5e-fcde266b4025, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025 1073741824" returned: 0 in 0.399s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.644s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=92,cinder:UPDATE=79,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efc7fc3-2a6f-4305-b62a-aa0362cf4427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303f7894-b312-4b75-ba5e-fcde266b4025', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4acc93-4904-4885-9987-eac0c188cc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=78,cinder:UPDATE=77,cinder:INSERT=24,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:50:28 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Volume volume-303f7894-b312-4b75-ba5e-fcde266b4025 (303f7894-b312-4b75-ba5e-fcde266b4025): created successfully
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4acc93-4904-4885-9987-eac0c188cc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (687ac9da-a390-4ad9-944b-95b300fbf377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-eba7aeee-8935-4b4c-be74-4d0863ede7a6 tempest-GroupsTest-265254430 None] Created volume successfully.
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "cinder-cfe09320-e5fc-40d5-b9f1-0796f467960b-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-cfe09320-e5fc-40d5-b9f1-0796f467960b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "cinder-quobyte-cfe09320-e5fc-40d5-b9f1-0796f467960b" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-quobyte-cfe09320-e5fc-40d5-b9f1-0796f467960b" acquired by "delete_volume" :: waited 0.010s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d75134-496b-4b5c-b7c7-653b8cbfe1b0]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b" returned: 0 in 0.430s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cfe09320-e5fc-40d5-b9f1-0796f467960b" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-quobyte-cfe09320-e5fc-40d5-b9f1-0796f467960b" released by "delete_volume" :: held 0.750s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (1be7b313-2dac-4385-8059-1aa656332d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30a38aa-9d18-4517-b6e1-d21aabe359c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Created reservations ['f22f5d07-f6f6-4cc2-a19e-3f24b4d28890', 'de2b03bd-ece5-45e7-b412-a662b283dc6c', '5b7e3d63-f747-4613-b2b0-1e6586482394', 'b61cb7e2-6042-4121-b39c-d21d3ac38640'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30a38aa-9d18-4517-b6e1-d21aabe359c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676763913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=667d47d1-bc03-4aa1-859e-29c3483e16df,host='devstack@QuobyteHD#QuobyteHD',id=fbf48aed-2702-49d9-9857-b321dad3fc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:30Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db41391c-d018-43b2-a3fc-272e9b09ff5c),volume_type_id=db41391c-d018-43b2-a3fc-272e9b09ff5c)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c793a9-43e4-42df-aa93-41a1f72e7730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c793a9-43e4-42df-aa93-41a1f72e7730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7b36fc-e8e8-48a6-b84d-699b173309a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7b36fc-e8e8-48a6-b84d-699b173309a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf48aed-2702-49d9-9857-b321dad3fc2c', 'volume_name': 'volume-fbf48aed-2702-49d9-9857-b321dad3fc2c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44b848-dd5f-489b-8b00-e1754d04a18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee44b848-dd5f-489b-8b00-e1754d04a18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ee99ec-4fb4-4884-8664-e5c7e51f8df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:30 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Volume fbf48aed-2702-49d9-9857-b321dad3fc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf48aed-2702-49d9-9857-b321dad3fc2c', 'volume_size': 1}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=667d47d1-bc03-4aa1-859e-29c3483e16df,created_at=2025-09-24T15:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676763913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=667d47d1-bc03-4aa1-859e-29c3483e16df,host='devstack@QuobyteHD#QuobyteHD',id=fbf48aed-2702-49d9-9857-b321dad3fc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2070f3df33f44e3c9d2d7d35d38c67d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:30Z,use_quota=True,user_id='37f6796a32f64e4b9a68830121c7e868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db41391c-d018-43b2-a3fc-272e9b09ff5c),volume_type_id=db41391c-d018-43b2-a3fc-272e9b09ff5c)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Creating volume fbf48aed-2702-49d9-9857-b321dad3fc2c {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:50:30 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:30 devstack quobyte-client[84528]: System call of process 90540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:30 devstack quobyte-client[84528]: System call of process 90540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:30 devstack quobyte-client[84528]: System call of process 90540 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:30 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=29, name=volume-fbf48aed-2702-49d9-9857-b321dad3fc2c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c 1073741824" returned: 0 in 0.470s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c" returned: 0 in 0.337s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "cinder-a4885aab-91e4-4eeb-9c17-1491bc35ab61-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ee99ec-4fb4-4884-8664-e5c7e51f8df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf48aed-2702-49d9-9857-b321dad3fc2c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8be569-a1dc-4071-9d7c-3ea6706cc8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.452s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:31 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Volume volume-fbf48aed-2702-49d9-9857-b321dad3fc2c (fbf48aed-2702-49d9-9857-b321dad3fc2c): created successfully
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8be569-a1dc-4071-9d7c-3ea6706cc8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Flow 'volume_create_manager' (1be7b313-2dac-4385-8059-1aa656332d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Deleted volume successfully.
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-a4885aab-91e4-4eeb-9c17-1491bc35ab61-delete_volume" acquired by "delete_volume" :: waited 0.191s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-de50d95d-1c00-49b9-bf05-f8b2ab5892ce tempest-GroupsTest-265254430 None] Created volume successfully.
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-431fbd85-829f-4bf9-8f2a-f605a01e4060 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-cfe09320-e5fc-40d5-b9f1-0796f467960b-delete_volume" released by "delete_volume" :: held 2.866s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "cinder-quobyte-a4885aab-91e4-4eeb-9c17-1491bc35ab61" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-quobyte-a4885aab-91e4-4eeb-9c17-1491bc35ab61" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f64f664-1ef8-4f83-96b7-3780681aa136]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-649330b0-ba00-476e-ae5b-2ce47b96d900 req-3c62eaa4-c00d-4d78-b18b-e66c0de7e9ff tempest-TaggedAttachmentsTest-607834690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-649330b0-ba00-476e-ae5b-2ce47b96d900 req-3c62eaa4-c00d-4d78-b18b-e66c0de7e9ff tempest-TaggedAttachmentsTest-607834690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-649330b0-ba00-476e-ae5b-2ce47b96d900 req-3c62eaa4-c00d-4d78-b18b-e66c0de7e9ff tempest-TaggedAttachmentsTest-607834690 None] Terminate volume connection completed successfully.
Sep 24 17:50:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-649330b0-ba00-476e-ae5b-2ce47b96d900 req-3c62eaa4-c00d-4d78-b18b-e66c0de7e9ff tempest-TaggedAttachmentsTest-607834690 None] Deleting attachment 758a72c0-ca03-432c-a8a7-43849f367f6d. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:50:32 devstack quobyte-client[84528]: System call of process 90546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:32 devstack quobyte-client[84528]: System call of process 90546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:32 devstack quobyte-client[84528]: System call of process 90546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e93fbca3-af59-4615-a2d7-c161ecd4fbda tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61" returned: 0 in 0.826s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a4885aab-91e4-4eeb-9c17-1491bc35ab61" returned: 0 in 0.346s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-quobyte-a4885aab-91e4-4eeb-9c17-1491bc35ab61" released by "delete_volume" :: held 1.349s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e93fbca3-af59-4615-a2d7-c161ecd4fbda tempest-GroupsTest-265254430 None] Update group completed successfully.
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Created reservations ['afc3079a-9203-4bea-b9eb-6d55f48b7917', '562cefa8-5bd8-46f8-9a92-2c4706823cc0', '9e28080b-92f7-48bf-9ed4-51d905a05d11', '11d69cbd-a8bb-472a-8061-3ef178f43b54'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:33 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Deleted volume successfully.
Sep 24 17:50:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b589d57e-639b-4fc2-ab37-98d316247d51 tempest-AttachVolumeShelveTestJSON-1216312989 None] Lock "cinder-a4885aab-91e4-4eeb-9c17-1491bc35ab61-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-51a1bb3f-738b-4504-aa5d-cf5bdd80b61c tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-51a1bb3f-738b-4504-aa5d-cf5bdd80b61c tempest-GroupsTest-265254430 None] Update group completed successfully.
Sep 24 17:50:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Acquiring lock "cinder-quobyte-303f7894-b312-4b75-ba5e-fcde266b4025" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-303f7894-b312-4b75-ba5e-fcde266b4025" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adbbdc3-df28-49e9-aa50-a4824b8435e9]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:37 devstack quobyte-client[84528]: System call of process 90570 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025" returned: 0 in 0.712s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-303f7894-b312-4b75-ba5e-fcde266b4025" returned: 0 in 0.263s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-303f7894-b312-4b75-ba5e-fcde266b4025" released by "delete_volume" :: held 1.273s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Acquiring lock "cinder-quobyte-fbf48aed-2702-49d9-9857-b321dad3fc2c" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-fbf48aed-2702-49d9-9857-b321dad3fc2c" acquired by "delete_volume" :: waited 0.046s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd22810-27db-45d8-97fd-9ef7eec35296]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c" returned: 0 in 0.734s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fbf48aed-2702-49d9-9857-b321dad3fc2c" returned: 0 in 0.233s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "cinder-quobyte-fbf48aed-2702-49d9-9857-b321dad3fc2c" released by "delete_volume" :: held 1.226s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:39 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Created reservations ['45aef9d2-132b-4a57-be6e-c43c203edd74'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:39 devstack cinder-volume[84502]: WARNING cinder.quota [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-752501411 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-752501411, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:39 devstack cinder-volume[84502]: WARNING cinder.quota [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-752501411 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-752501411, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:50:39 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Created reservations ['8c1f6d93-7bf8-4736-9f34-3b2fc7572bb7', '003d05f3-35a8-4df4-897f-030a0970ad4c', 'fb23c35d-b546-409a-aafe-b5561addebcd', '5a33fc82-0555-46a0-9fb9-d3670e6f6d3d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Created reservations ['0fef0eaa-d75a-4834-b5ec-b13f299f807d', 'd330f036-3d6a-4452-8f48-679ac6aa6e05', '6404a1f3-1eec-48e7-8019-ed364404a1fa', '767bff99-f7e6-4a60-a2e7-3d15ac2c2cca'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.146s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:40 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ffe464fd-8f46-47ea-989b-ebecc5b0f909 tempest-GroupsTest-265254430 None] Delete group completed successfully.
Sep 24 17:50:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Flow 'volume_create_manager' (1a585d2b-f606-4415-9bbd-e947625d9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6add87-8b4d-4655-b283-d890cde77d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6add87-8b4d-4655-b283-d890cde77d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1085310414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13fd1b8-a599-48f3-948f-c572c1c4035b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7afe66a5b0464cbe9bfbc01213845ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:46Z,use_quota=True,user_id='4db165c8799c43038ad62a686174986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fad1b6-ee0c-4b88-be75-73baa5b83bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fad1b6-ee0c-4b88-be75-73baa5b83bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f1f196-08f3-48d9-b71a-0cd40401fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f1f196-08f3-48d9-b71a-0cd40401fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13fd1b8-a599-48f3-948f-c572c1c4035b', 'volume_name': 'volume-e13fd1b8-a599-48f3-948f-c572c1c4035b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd72617-21f1-48bb-8740-79d468e40c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd72617-21f1-48bb-8740-79d468e40c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970bb8d6-9e1d-4e3e-ac1a-0cf213d7397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Volume e13fd1b8-a599-48f3-948f-c572c1c4035b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13fd1b8-a599-48f3-948f-c572c1c4035b', 'volume_size': 1}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1085310414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13fd1b8-a599-48f3-948f-c572c1c4035b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7afe66a5b0464cbe9bfbc01213845ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:50:46Z,use_quota=True,user_id='4db165c8799c43038ad62a686174986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Creating volume e13fd1b8-a599-48f3-948f-c572c1c4035b {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:50:46 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:46 devstack quobyte-client[84528]: System call of process 90585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:46 devstack quobyte-client[84528]: System call of process 90585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:46 devstack quobyte-client[84528]: System call of process 90585 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:50:46 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=30, name=volume-e13fd1b8-a599-48f3-948f-c572c1c4035b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b 1073741824" returned: 0 in 0.370s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b" returned: 0 in 0.141s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:50:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970bb8d6-9e1d-4e3e-ac1a-0cf213d7397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13fd1b8-a599-48f3-948f-c572c1c4035b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338e4c84-aa13-45e1-9828-4aafb7412890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:50:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Volume volume-e13fd1b8-a599-48f3-948f-c572c1c4035b (e13fd1b8-a599-48f3-948f-c572c1c4035b): created successfully
Sep 24 17:50:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338e4c84-aa13-45e1-9828-4aafb7412890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:50:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Flow 'volume_create_manager' (1a585d2b-f606-4415-9bbd-e947625d9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:50:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-5f767cac-8e56-445a-80c0-7932693adea5 req-be9e2bb7-cf3b-4821-a737-13e534ad436b tempest-VolumesGetTestJSON-612658300 None] Created volume successfully.
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Acquiring lock "cinder-e13fd1b8-a599-48f3-948f-c572c1c4035b-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "cinder-e13fd1b8-a599-48f3-948f-c572c1c4035b-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Acquiring lock "cinder-quobyte-e13fd1b8-a599-48f3-948f-c572c1c4035b" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "cinder-quobyte-e13fd1b8-a599-48f3-948f-c572c1c4035b" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21c03e-dc2f-42dc-925b-445569f3793a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:50:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b" returned: 0 in 0.514s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e13fd1b8-a599-48f3-948f-c572c1c4035b" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "cinder-quobyte-e13fd1b8-a599-48f3-948f-c572c1c4035b" released by "delete_volume" :: held 0.870s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG cinder.quota [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Created reservations ['49bf2394-f012-4a39-8d9d-4fa0c439d4db', '2272c957-23c6-4d7b-a208-ca76b7bd16fd', '0c3713b8-392d-44d3-a8d9-fad423376546', 'ef371c63-0403-4aab-9da1-110dbadf21c4'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:50:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:50:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.139s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:50:50 devstack cinder-volume[84502]: DEBUG cinder.manager [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:50:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Deleted volume successfully.
Sep 24 17:50:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-ea9d9ebb-b2a8-47ba-b6be-99a0df7a5221 req-f642044a-a871-4a96-9104-0e34e3c78a01 tempest-VolumesGetTestJSON-612658300 None] Lock "cinder-e13fd1b8-a599-48f3-948f-c572c1c4035b-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=54,cinder:DELETE=6,cinder:SELECT=36,cinder:INSERT=13 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:51:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=45,cinder:SELECT=37,cinder:INSERT=8 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:51:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Flow 'volume_create_manager' (83a24b00-cd4d-44b9-9b67-3e10d2ce255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cfaf3d-dabb-4b0e-b7dd-05c4517d6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cfaf3d-dabb-4b0e-b7dd-05c4517d6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-829842047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00c8a84-76a5-45ae-b317-69570b6fbd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96393d0502794714a91b067dc470adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:51:16Z,use_quota=True,user_id='50a7ca21dbb24450abebe767b9fa5b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd8fd30-3f6c-4151-b8a1-9405bef45805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd8fd30-3f6c-4151-b8a1-9405bef45805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf9e626-9766-4ba2-8b87-783fe31bc069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf9e626-9766-4ba2-8b87-783fe31bc069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00c8a84-76a5-45ae-b317-69570b6fbd62', 'volume_name': 'volume-a00c8a84-76a5-45ae-b317-69570b6fbd62', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a93194-3910-4f6c-8b0d-f285e3f1ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a93194-3910-4f6c-8b0d-f285e3f1ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770a18a9-743a-4089-8981-60c33885b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:16 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Volume a00c8a84-76a5-45ae-b317-69570b6fbd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00c8a84-76a5-45ae-b317-69570b6fbd62', 'volume_size': 1}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-829842047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00c8a84-76a5-45ae-b317-69570b6fbd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96393d0502794714a91b067dc470adbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:51:16Z,use_quota=True,user_id='50a7ca21dbb24450abebe767b9fa5b30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Creating volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:51:16 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.528s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:51:16 devstack quobyte-client[84528]: System call of process 90686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:16 devstack quobyte-client[84528]: System call of process 90686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:16 devstack quobyte-client[84528]: System call of process 90686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:16 devstack quobyte-client[84528]: System call of process 90686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:16 devstack quobyte-client[84528]: System call of process 90686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:16 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=31, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 1073741824" returned: 0 in 0.636s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62" returned: 0 in 0.138s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] <== create_volume: return (846ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770a18a9-743a-4089-8981-60c33885b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00c8a84-76a5-45ae-b317-69570b6fbd62', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff0d49-3904-438a-b1cc-26e6028ce6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Volume volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 (a00c8a84-76a5-45ae-b317-69570b6fbd62): created successfully
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff0d49-3904-438a-b1cc-26e6028ce6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Flow 'volume_create_manager' (83a24b00-cd4d-44b9-9b67-3e10d2ce255c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:51:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fae36fdb-2ccd-4f32-939d-6be53d700ba5 tempest-SnapshotsActionsTest-1034473405 None] Created volume successfully.
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "cinder-5d0a6c96-b003-4322-a92f-319fb1e4e658-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "cinder-5d0a6c96-b003-4322-a92f-319fb1e4e658-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Creating offline snapshot 5e60c35f-319d-4e3c-bc94-fc4232cc80b8 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496ff05-6805-4eed-8b7b-2988652980d1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "cinder-quobyte-5d0a6c96-b003-4322-a92f-319fb1e4e658" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "cinder-quobyte-5d0a6c96-b003-4322-a92f-319fb1e4e658" acquired by "delete_volume" :: waited 0.092s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbbe8c-3635-468c-b0da-d5ab9147d5bd]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62" returned: 0 in 0.604s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:19 devstack quobyte-client[84528]: System call of process 90698 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:19 devstack quobyte-client[84528]: System call of process 90695 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:19 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=32, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658" returned: 0 in 0.614s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 1G" returned: 0 in 0.521s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-5d0a6c96-b003-4322-a92f-319fb1e4e658" returned: 0 in 0.237s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:20 devstack quobyte-client[84528]: System call of process 90704 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "cinder-quobyte-5d0a6c96-b003-4322-a92f-319fb1e4e658" released by "delete_volume" :: held 1.103s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.343s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.259s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:51:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.298s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.info" returned: 0 in 0.194s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Created reservations ['60c621aa-528c-479a-8694-d9dd094cb3a9', 'f906c872-a897-4d93-8d89-7cd3ee951c16', 'f8a952eb-be60-4920-b8db-6765a0965938', '7afd6f54-bacd-4594-9eca-0766e36086c3'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.info" returned: 0 in 0.250s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:21 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-188282d3-0ace-40b2-a61b-7bb1eafc9b0e tempest-SnapshotsActionsTest-1034473405 None] Create snapshot completed successfully
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.111s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:22 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:51:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Deleted volume successfully.
Sep 24 17:51:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-162ce0ad-64bb-4995-a895-4935c804792a tempest-TaggedAttachmentsTest-607834690 None] Lock "cinder-5d0a6c96-b003-4322-a92f-319fb1e4e658-delete_volume" released by "delete_volume" :: held 3.608s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:24 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Creating offline snapshot a6a498a7-f605-40f6-af61-009dc7e38045 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:51:24 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a783854-1465-4ef0-8975-e19d0b02db49]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:24 devstack quobyte-client[84528]: System call of process 90714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.872s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:25 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=34, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 1G" returned: 0 in 0.590s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:25 devstack quobyte-client[84528]: System call of process 90720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:25 devstack quobyte-client[84528]: System call of process 90720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:25 devstack quobyte-client[84528]: System call of process 90720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.266s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.234s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.215s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-449bbdcd-78c2-4b6e-8c2e-46c024aca667 tempest-SnapshotsActionsTest-1034473405 None] Create snapshot completed successfully
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-a6a498a7-f605-40f6-af61-009dc7e38045-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-a6a498a7-f605-40f6-af61-009dc7e38045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-a6a498a7-f605-40f6-af61-009dc7e38045" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a6a498a7-f605-40f6-af61-009dc7e38045" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Deleting offline snapshot a6a498a7-f605-40f6-af61-009dc7e38045 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] snapshot_file for this snap is: volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dd6884-5d22-4e97-a43f-c941d1a7483b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:28 devstack quobyte-client[84528]: System call of process 90725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.553s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[28925385-492e-49a1-b9d8-a2c4f0087ea8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:28 devstack quobyte-client[84528]: System call of process 90728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.480s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:29 devstack quobyte-client[84528]: System call of process 90731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:29 devstack quobyte-client[84528]: System call of process 90731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.397s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.a6a498a7-f605-40f6-af61-009dc7e38045" returned: 0 in 0.120s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a6a498a7-f605-40f6-af61-009dc7e38045" released by "_delete_snapshot" :: held 2.013s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_snapshot" :: held 2.060s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:30 devstack cinder-volume[84502]: WARNING cinder.quota [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:51:30 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Created reservations ['31f508c1-34f0-4535-8d2f-9f5d77207f49', 'ff9afb00-16d7-4c03-bedc-be8cdc77f913', 'ddd42932-2768-45af-9dd7-21b78d4a0544', '81fcb590-3783-4cd3-af76-fc24c3d247f5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Delete snapshot completed successfully.
Sep 24 17:51:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a87e8c4-552f-4d75-bae2-ddb09eb9207c tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-a6a498a7-f605-40f6-af61-009dc7e38045-delete_snapshot" released by "delete_snapshot" :: held 2.665s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Creating offline snapshot 44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:51:31 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d82600-f696-4877-aa76-c298d33a9a60]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:32 devstack quobyte-client[84528]: System call of process 90737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:32 devstack quobyte-client[84528]: System call of process 90737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.612s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:32 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=35, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc 1G" returned: 0 in 0.570s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:33 devstack quobyte-client[84528]: System call of process 90744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.355s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.168s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.140s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f01b23f1-c89c-48f6-937b-f991068d98d4 tempest-SnapshotsActionsTest-1034473405 None] Create snapshot completed successfully
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Flow 'volume_create_manager' (18510a2b-3b7d-4fa3-bb9a-9e1446a2fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a270a069-a72c-4f96-accf-423f7f9a0724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" acquired by "_delete_snapshot" :: waited 0.089s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Deleting offline snapshot 44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] snapshot_file for this snap is: volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcba9c16-da00-49e2-a118-811467be3d19]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a270a069-a72c-4f96-accf-423f7f9a0724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1322314505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6a66d2-02ad-4751-9ecc-72ee473d73ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c28accc06004410b3ef0a68a1ca0d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:51:35Z,use_quota=True,user_id='e8dfee3543614128a8722bff6b7122b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bfee86d-5013-46c4-9d50-c50a7dcb3184),volume_type_id=9bfee86d-5013-46c4-9d50-c50a7dcb3184)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ade181-af04-475f-93e9-83ecddeb9aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ade181-af04-475f-93e9-83ecddeb9aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd344910-93ac-450d-a82c-2eee34b288ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd344910-93ac-450d-a82c-2eee34b288ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a6a66d2-02ad-4751-9ecc-72ee473d73ce', 'volume_name': 'volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799f45f7-5cf3-43a1-8081-0f4d0e9a2db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799f45f7-5cf3-43a1-8081-0f4d0e9a2db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3b70d0-9d92-4051-8725-3ad5c4882ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:35 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume 2a6a66d2-02ad-4751-9ecc-72ee473d73ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce', 'volume_size': 1}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1322314505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a6a66d2-02ad-4751-9ecc-72ee473d73ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c28accc06004410b3ef0a68a1ca0d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:51:35Z,use_quota=True,user_id='e8dfee3543614128a8722bff6b7122b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bfee86d-5013-46c4-9d50-c50a7dcb3184),volume_type_id=9bfee86d-5013-46c4-9d50-c50a7dcb3184)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Creating volume 2a6a66d2-02ad-4751-9ecc-72ee473d73ce {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:51:35 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:35 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=36, name=volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:35 devstack quobyte-client[84528]: System call of process 90749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.786s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[47664508-6904-4f09-9a6e-6513aca81256]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce 1073741824" returned: 0 in 0.678s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" returned: 0 in 0.178s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] <== create_volume: return (1001ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:36 devstack quobyte-client[84528]: System call of process 90755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3b70d0-9d92-4051-8725-3ad5c4882ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc89036-797a-440e-a51c-f397f40186f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.838s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:37 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce (2a6a66d2-02ad-4751-9ecc-72ee473d73ce): created successfully
Sep 24 17:51:37 devstack quobyte-client[84528]: System call of process 90759 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc89036-797a-440e-a51c-f397f40186f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Flow 'volume_create_manager' (18510a2b-3b7d-4fa3-bb9a-9e1446a2fb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:51:37 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b12f58a0-3fc2-4e95-a22a-7c3215baa6cd tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Created volume successfully.
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.521s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" returned: 0 in 0.132s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc" released by "_delete_snapshot" :: held 2.583s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_snapshot" :: held 2.683s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:37 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Created reservations ['3b3c80a8-87a0-47fd-b61c-9c775ac620a0', '47f92dc4-83bd-4341-a4dd-bca36e02c399', 'a44dc08f-0da8-407b-9bdd-d377fffe6658', '72a08ade-10c8-4ad1-8c7d-9ac478f8e88b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Delete snapshot completed successfully.
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2cf08cab-9518-44d0-b5cd-a38d3f138527 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-44bdb825-cc1e-4dbd-a7e8-8ac1de9050fc-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.108s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:39 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:51:39 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c7362efc-9f99-4b69-8dbe-d329b807b83c tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Retype volume completed successfully.
Sep 24 17:51:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Creating offline snapshot 039623a1-288d-4dd3-a8a6-3dfdc54b1116 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[51682d7e-73bb-4366-a740-e62f69f260fe]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "cinder-2a6a66d2-02ad-4751-9ecc-72ee473d73ce-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "cinder-2a6a66d2-02ad-4751-9ecc-72ee473d73ce-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:40 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "cinder-quobyte-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.652s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "cinder-quobyte-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" acquired by "delete_volume" :: waited 0.152s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:40 devstack quobyte-client[84528]: System call of process 90769 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7665ee-ef9a-4cdc-b518-136e3bd6ed47]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:40 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=37, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 1G" returned: 0 in 0.396s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:41 devstack quobyte-client[84528]: System call of process 90773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.258s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:41 devstack quobyte-client[84528]: System call of process 90772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:41 devstack quobyte-client[84528]: System call of process 90772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.132s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" returned: 0 in 0.776s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.250s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" returned: 0 in 0.411s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "cinder-quobyte-2a6a66d2-02ad-4751-9ecc-72ee473d73ce" released by "delete_volume" :: held 1.470s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1dac0338-89ac-4b1a-a49c-07a1b799e99b tempest-SnapshotsActionsTest-1034473405 None] Create snapshot completed successfully
Sep 24 17:51:42 devstack cinder-volume[84502]: WARNING cinder.quota [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:51:42 devstack cinder-volume[84502]: WARNING cinder.quota [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Created reservations ['880ea6e1-bc60-4892-af7b-2493cc21dbdf', 'c292d921-8f66-417f-a0ae-357977fb1495', 'e79aa68b-8fa9-4e73-a9ae-b705374c35ea', '60fb5bb6-d2cd-409b-9fb9-21a613801f85'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.128s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:42 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:51:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Deleted volume successfully.
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-039623a1-288d-4dd3-a8a6-3dfdc54b1116-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f885f0c3-8380-4f70-9690-7f275c53f8b0 tempest-VolumeRetypeWithoutMigrationTest-1951709545 None] Lock "cinder-2a6a66d2-02ad-4751-9ecc-72ee473d73ce-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-039623a1-288d-4dd3-a8a6-3dfdc54b1116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-039623a1-288d-4dd3-a8a6-3dfdc54b1116" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-039623a1-288d-4dd3-a8a6-3dfdc54b1116" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Deleting offline snapshot 039623a1-288d-4dd3-a8a6-3dfdc54b1116 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] snapshot_file for this snap is: volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e21df5-1b18-418d-a8e6-d4c740880cb8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:43 devstack quobyte-client[84528]: System call of process 90782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.530s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9e0e4-3c99-41c2-83af-19c28f76e178]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.509s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.288s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.039623a1-288d-4dd3-a8a6-3dfdc54b1116" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-039623a1-288d-4dd3-a8a6-3dfdc54b1116" released by "_delete_snapshot" :: held 1.881s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_snapshot" :: held 1.912s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:45 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Created reservations ['064be280-996d-4e1f-981d-70ce8622a54e', '2bbe4900-2936-48b8-9b04-2ff6aa6dc8af', '43d1a7f5-e3e7-4242-b9d5-e3a08f84d51f', 'fee736e8-3be1-4f4b-b00c-e1a817538cd3'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:45 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Delete snapshot completed successfully.
Sep 24 17:51:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9a2c0efb-8a90-4e38-bc3f-543de8672972 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-039623a1-288d-4dd3-a8a6-3dfdc54b1116-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:47 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:51:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:51:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Creating offline snapshot ba0c5576-fee1-445a-8a25-3e90c179d11e of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:51:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d572ece3-be53-44e4-a8fb-653702d47c61]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:48 devstack quobyte-client[84528]: System call of process 90792 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.723s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:48 devstack quobyte-client[84528]: System call of process 90795 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:48 devstack quobyte-client[84528]: System call of process 90795 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:48 devstack quobyte-client[84528]: System call of process 90795 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:48 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=38, name=volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e 1G" returned: 0 in 0.577s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:49 devstack quobyte-client[84528]: System call of process 90798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img rebase -u -b volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.313s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.329s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:51:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.167s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:51:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-86051c51-6f92-46d2-a681-437487122778 tempest-SnapshotsActionsTest-1034473405 None] Create snapshot completed successfully
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-ba0c5576-fee1-445a-8a25-3e90c179d11e-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-ba0c5576-fee1-445a-8a25-3e90c179d11e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.131s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Acquiring lock "cinder-quobyte-ba0c5576-fee1-445a-8a25-3e90c179d11e" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-ba0c5576-fee1-445a-8a25-3e90c179d11e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Deleting offline snapshot ba0c5576-fee1-445a-8a25-3e90c179d11e of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] snapshot_file for this snap is: volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d17641f-660a-4082-9524-b3091f7dfe23]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:51 devstack quobyte-client[84528]: System call of process 90804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.597s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e520b2-b376-4458-b851-166457433096]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:52 devstack quobyte-client[84528]: System call of process 90807 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.712s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:52 devstack quobyte-client[84528]: System call of process 90810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.383s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.ba0c5576-fee1-445a-8a25-3e90c179d11e" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-ba0c5576-fee1-445a-8a25-3e90c179d11e" released by "_delete_snapshot" :: held 2.223s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_snapshot" :: held 2.257s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:53 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Created reservations ['e2ad6222-b1a4-4549-9af8-c703ff54b112', 'cd5b0a20-8cc3-4cc5-b6d5-0d866c3295e6', 'c3d7b9a2-4f99-4f39-8d4c-ef7a3ca5e282', '38340165-53bc-4e70-bd24-f9bff988d9d5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:54 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Delete snapshot completed successfully.
Sep 24 17:51:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9d4c2094-f0aa-4e39-8c91-6a998eb43e76 tempest-SnapshotsActionsTest-68237719 None] Lock "cinder-ba0c5576-fee1-445a-8a25-3e90c179d11e-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "cinder-5e60c35f-319d-4e3c-bc94-fc4232cc80b8-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-5e60c35f-319d-4e3c-bc94-fc4232cc80b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:55 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "cinder-quobyte-5e60c35f-319d-4e3c-bc94-fc4232cc80b8" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-5e60c35f-319d-4e3c-bc94-fc4232cc80b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Deleting offline snapshot 5e60c35f-319d-4e3c-bc94-fc4232cc80b8 of volume a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] snapshot_file for this snap is: volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c81ef39-1159-4532-8562-0d3e24c8709f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:55 devstack quobyte-client[84528]: System call of process 90820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:55 devstack quobyte-client[84528]: System call of process 90820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:55 devstack quobyte-client[84528]: System call of process 90820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.534s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a00c8a84-76a5-45ae-b317-69570b6fbd62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[953d2db0-e691-4ce7-8b4b-54ff8b1597e2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:56 devstack quobyte-client[84528]: System call of process 90823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62" returned: 0 in 0.517s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.304s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62.5e60c35f-319d-4e3c-bc94-fc4232cc80b8" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-5e60c35f-319d-4e3c-bc94-fc4232cc80b8" released by "_delete_snapshot" :: held 1.914s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_snapshot" :: held 1.943s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:57 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Created reservations ['db7bc86d-d065-4acb-9b48-488d49e9477e', 'eec6e4ca-059c-4ffb-bede-ac4b8c62cee4', '399a4a96-439b-4afe-be96-2ea80ccc2920', '53c71500-1bfd-4b13-92a1-4519ddbd7887'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:51:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Delete snapshot completed successfully.
Sep 24 17:51:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cf3eb735-553d-479d-be63-f6149b677593 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-5e60c35f-319d-4e3c-bc94-fc4232cc80b8-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "cinder-a00c8a84-76a5-45ae-b317-69570b6fbd62-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-a00c8a84-76a5-45ae-b317-69570b6fbd62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" acquired by "delete_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d5826-e2df-4564-99e0-b4604b20c872]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:51:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:51:59 devstack quobyte-client[84528]: System call of process 90830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:59 devstack quobyte-client[84528]: System call of process 90830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:59 devstack quobyte-client[84528]: System call of process 90830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:51:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62" returned: 0 in 0.689s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:51:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a00c8a84-76a5-45ae-b317-69570b6fbd62" returned: 0 in 0.334s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-quobyte-a00c8a84-76a5-45ae-b317-69570b6fbd62" released by "delete_volume" :: held 1.388s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Created reservations ['4bd43225-339f-4bfa-87ed-4318b7b06551', 'fc684a3f-e760-429b-a3a5-4d95d7941065', '48d3c73e-a468-49f4-b82b-3a131884a48f', 'ce7a1d4d-785b-42a0-b408-5511d59477cc'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:52:01 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Deleted volume successfully.
Sep 24 17:52:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5c97dd33-7139-45f2-bbc4-aae501bb3a70 tempest-SnapshotsActionsTest-1034473405 None] Lock "cinder-a00c8a84-76a5-45ae-b317-69570b6fbd62-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:11 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=60,cinder:UPDATE=67,cinder:DELETE=4,cinder:INSERT=19 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:52:11 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=63,cinder:SELECT=48,cinder:INSERT=13,cinder:DELETE=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.216s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:52:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Flow 'volume_create_manager' (53325a21-2c83-439e-a799-96ccde05aaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d0e98d-03bc-4d81-aec6-cf7243c46dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d0e98d-03bc-4d81-aec6-cf7243c46dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1040933576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7438744d-933f-48a5-9b9e-089b22c316b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cf16837cac4345950e2c6a123a64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:26Z,use_quota=True,user_id='482e6c8d85754bef90a491eb9d65195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fe7699-60e5-46e9-9d63-4214e0c80e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11fe7699-60e5-46e9-9d63-4214e0c80e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57cbabd-9cac-47b7-8e61-ca1ce0592dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f57cbabd-9cac-47b7-8e61-ca1ce0592dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7438744d-933f-48a5-9b9e-089b22c316b1', 'volume_name': 'volume-7438744d-933f-48a5-9b9e-089b22c316b1', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a44fb-ab8b-4dd7-a78a-50c783228db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a44fb-ab8b-4dd7-a78a-50c783228db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfadd10f-b369-45dd-92a3-5a684ee08a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume 7438744d-933f-48a5-9b9e-089b22c316b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7438744d-933f-48a5-9b9e-089b22c316b1', 'volume_size': 1}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1040933576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7438744d-933f-48a5-9b9e-089b22c316b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cf16837cac4345950e2c6a123a64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:26Z,use_quota=True,user_id='482e6c8d85754bef90a491eb9d65195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Creating volume 7438744d-933f-48a5-9b9e-089b22c316b1 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:52:26 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:26 devstack quobyte-client[84528]: System call of process 90896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:26 devstack quobyte-client[84528]: System call of process 90896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:26 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=39, name=volume-7438744d-933f-48a5-9b9e-089b22c316b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1 1073741824" returned: 0 in 0.683s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1" returned: 0 in 0.216s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] <== create_volume: return (1120ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfadd10f-b369-45dd-92a3-5a684ee08a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7438744d-933f-48a5-9b9e-089b22c316b1', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c577f956-b53b-4065-b9ec-08d845ab6392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume volume-7438744d-933f-48a5-9b9e-089b22c316b1 (7438744d-933f-48a5-9b9e-089b22c316b1): created successfully
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c577f956-b53b-4065-b9ec-08d845ab6392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Flow 'volume_create_manager' (53325a21-2c83-439e-a799-96ccde05aaf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:52:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7e1ae19a-cdb5-4f18-925a-3a4903d698a9 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Created volume successfully.
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "cinder-7438744d-933f-48a5-9b9e-089b22c316b1-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "cinder-7438744d-933f-48a5-9b9e-089b22c316b1-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:52:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "cinder-quobyte-7438744d-933f-48a5-9b9e-089b22c316b1" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "cinder-quobyte-7438744d-933f-48a5-9b9e-089b22c316b1" acquired by "delete_volume" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[426242f2-d8c6-4e0a-829c-769f3dcfe25a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:52:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:31 devstack quobyte-client[84528]: System call of process 90959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:31 devstack quobyte-client[84528]: System call of process 90959 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1" returned: 0 in 1.095s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7438744d-933f-48a5-9b9e-089b22c316b1" returned: 0 in 0.301s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "cinder-quobyte-7438744d-933f-48a5-9b9e-089b22c316b1" released by "delete_volume" :: held 1.839s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Created reservations ['87a6d025-00f8-420a-84fe-0ecc55fee2ad', 'ca85ddd2-9e12-409f-a9f2-e3a45f5fd680', 'f93888b5-08d7-4212-ba1c-4138a96eb2bf', '8327a1b5-9c4f-41b1-8054-5fe64c7e6270'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.439s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:34 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:52:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Deleted volume successfully.
Sep 24 17:52:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9e55bda3-0a7c-471c-8d03-17e491bb9c7d tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "cinder-7438744d-933f-48a5-9b9e-089b22c316b1-delete_volume" released by "delete_volume" :: held 4.436s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Flow 'volume_create_manager' (55137807-f889-4a22-83ee-0753fe883f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e9928b-bca2-4677-abd9-78fee7633684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e9928b-bca2-4677-abd9-78fee7633684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-97939193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007a75b-c4dd-42bb-93b1-b09c0e499a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cf16837cac4345950e2c6a123a64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:35Z,use_quota=True,user_id='482e6c8d85754bef90a491eb9d65195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4826c479-e936-48dc-85c5-d38d319caef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4826c479-e936-48dc-85c5-d38d319caef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81510a78-d16d-4cd9-a962-07cc165053b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81510a78-d16d-4cd9-a962-07cc165053b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b007a75b-c4dd-42bb-93b1-b09c0e499a15', 'volume_name': 'volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ff8cc6-5b0f-48fc-9398-6a85440a2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ff8cc6-5b0f-48fc-9398-6a85440a2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba319f5-2056-4906-bb01-6dcf469d0adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:35 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume b007a75b-c4dd-42bb-93b1-b09c0e499a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15', 'volume_size': 1}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-97939193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007a75b-c4dd-42bb-93b1-b09c0e499a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45cf16837cac4345950e2c6a123a64d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:35Z,use_quota=True,user_id='482e6c8d85754bef90a491eb9d65195d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Creating volume b007a75b-c4dd-42bb-93b1-b09c0e499a15 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:52:35 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:35 devstack quobyte-client[84528]: System call of process 90980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:35 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=40, name=volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 1073741824" returned: 0 in 0.384s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15" returned: 0 in 0.180s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba319f5-2056-4906-bb01-6dcf469d0adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd35af1a-bf67-4b77-8c6a-2ba57645c944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Volume volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 (b007a75b-c4dd-42bb-93b1-b09c0e499a15): created successfully
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd35af1a-bf67-4b77-8c6a-2ba57645c944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Flow 'volume_create_manager' (55137807-f889-4a22-83ee-0753fe883f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:52:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-555a348d-8118-45bc-950c-96773adf1790 tempest-VolumeQuotasAdminTestJSON-1479311339 None] Created volume successfully.
Sep 24 17:52:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f6bdecf1-5a8a-4458-b38d-0fca2c6a7859 tempest-VolumeQuotasAdminTestJSON-2064455543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f6bdecf1-5a8a-4458-b38d-0fca2c6a7859 tempest-VolumeQuotasAdminTestJSON-2064455543 None] Transfer volume completed successfully.
Sep 24 17:52:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Acquiring lock "cinder-b007a75b-c4dd-42bb-93b1-b09c0e499a15-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "cinder-b007a75b-c4dd-42bb-93b1-b09c0e499a15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:52:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Acquiring lock "cinder-quobyte-b007a75b-c4dd-42bb-93b1-b09c0e499a15" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "cinder-quobyte-b007a75b-c4dd-42bb-93b1-b09c0e499a15" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1ea36-e396-44f9-a7af-4548b9535d61]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:39 devstack quobyte-client[84528]: System call of process 90984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:39 devstack quobyte-client[84528]: System call of process 90984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:39 devstack quobyte-client[84528]: System call of process 90984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15" returned: 0 in 0.581s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b007a75b-c4dd-42bb-93b1-b09c0e499a15" returned: 0 in 0.124s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "cinder-quobyte-b007a75b-c4dd-42bb-93b1-b09c0e499a15" released by "delete_volume" :: held 0.955s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Created reservations ['e1672098-f642-43c6-9594-704f179bf74f', '1f9c9254-4b35-4a5f-815c-38d300f2977c', 'a09fe9e0-224d-4ba9-a9d4-9d342f3663b2', 'aa5952ff-e782-45c9-a3db-618c7f778819'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:52:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Deleted volume successfully.
Sep 24 17:52:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e9c93588-282c-4970-8613-995f09c44977 tempest-VolumeQuotasAdminTestJSON-421802438 None] Lock "cinder-b007a75b-c4dd-42bb-93b1-b09c0e499a15-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:52:51 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=13,cinder:UPDATE=15,cinder:DELETE=3,cinder:INSERT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:52:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Flow 'volume_create_manager' (e8039d13-f561-44c9-a37c-9536ff0412ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7385d9b6-6f79-4821-9113-e88a24e77ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7385d9b6-6f79-4821-9113-e88a24e77ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1825988635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235536a954d9495abe52fbae3bb7ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:57Z,use_quota=True,user_id='a111661f2bdf402ab676a9b73bcc951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e1549-02be-4558-9254-0de512229635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e1549-02be-4558-9254-0de512229635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbbc582-7c10-4243-a2e4-20895b5a694a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdbbc582-7c10-4243-a2e4-20895b5a694a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953', 'volume_name': 'volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81a614d-5a71-4f7a-b0ee-62636cc6e30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81a614d-5a71-4f7a-b0ee-62636cc6e30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615723eb-4949-48cd-924d-6d10905841b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:52:56 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Volume 44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953', 'volume_size': 1}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1825988635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235536a954d9495abe52fbae3bb7ddc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:52:57Z,use_quota=True,user_id='a111661f2bdf402ab676a9b73bcc951a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Creating volume 44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:52:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:52:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:52:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:52:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:52:57 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:52:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:58 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=41, name=volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:52:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 1073741824" returned: 0 in 1.721s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:52:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" returned: 0 in 0.473s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:52:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] <== create_volume: return (2516ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:52:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.551s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615723eb-4949-48cd-924d-6d10905841b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512e8c06-18ec-4039-9ec4-aceae8f84593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Volume volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 (44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953): created successfully
Sep 24 17:53:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512e8c06-18ec-4039-9ec4-aceae8f84593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Flow 'volume_create_manager' (e8039d13-f561-44c9-a37c-9536ff0412ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-08e79b72-59f5-4ccf-9594-383f23468021 tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Created volume successfully.
Sep 24 17:53:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Acquiring lock "cinder-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "cinder-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953-delete_volume" acquired by "delete_volume" :: waited 0.226s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Acquiring lock "cinder-quobyte-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "cinder-quobyte-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" acquired by "delete_volume" :: waited 0.039s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:05 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1817f098-915b-44ed-8292-817f5ddfa401]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:06 devstack quobyte-client[84528]: System call of process 91105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:06 devstack quobyte-client[84528]: System call of process 91105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:06 devstack quobyte-client[84528]: System call of process 91105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" returned: 0 in 1.397s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" returned: 0 in 0.314s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "cinder-quobyte-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953" released by "delete_volume" :: held 2.467s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Created reservations ['6d5ce748-4b30-4b40-a75e-d363b46daf5f', '3258276d-5754-4984-8711-093cbd3678cc', '826ee20f-56da-4da4-8012-7b9e72c6ffa7', 'a0699c0b-d95f-4040-8c46-6ebe07074f36'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.230s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:08 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Deleted volume successfully.
Sep 24 17:53:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-73f472f6-afc7-48e0-97c1-314a4b47abbb tempest-VolumeQuotasNegativeTestJSON-2082389758 None] Lock "cinder-44ea5af3-9cf1-4c2c-8d0e-17ed7c86f953-delete_volume" released by "delete_volume" :: held 4.912s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:10 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (6dde9d23-3705-4a5a-8001-68edfd1aaecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac42682-7644-4bdf-b7da-02db3c736054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac42682-7644-4bdf-b7da-02db3c736054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1993139770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2a77c2-77a9-45f8-8466-ddf4c37b99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:10Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d258283f-aca6-475d-8f93-097633da4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d258283f-aca6-475d-8f93-097633da4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fe3edd-b6ed-4056-abbe-c428e86cda81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fe3edd-b6ed-4056-abbe-c428e86cda81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2a77c2-77a9-45f8-8466-ddf4c37b99f9', 'volume_name': 'volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c71f4e5-5124-4c8e-9b63-d43a1e306760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c71f4e5-5124-4c8e-9b63-d43a1e306760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0dd319-56ba-4655-ab1b-352167e79c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Volume bc2a77c2-77a9-45f8-8466-ddf4c37b99f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9', 'volume_size': 1}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1993139770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2a77c2-77a9-45f8-8466-ddf4c37b99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:10Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Creating volume bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:11 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:12 devstack quobyte-client[84528]: System call of process 91137 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:12 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=42, name=volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 1073741824" returned: 0 in 1.763s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" returned: 0 in 0.178s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (2083ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0dd319-56ba-4655-ab1b-352167e79c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be62d18-984f-42ed-be88-1ac8f0d9c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:14 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Volume volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 (bc2a77c2-77a9-45f8-8466-ddf4c37b99f9): created successfully
Sep 24 17:53:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be62d18-984f-42ed-be88-1ac8f0d9c217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (6dde9d23-3705-4a5a-8001-68edfd1aaecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b3f4814e-87e6-40ba-a4ab-812b45c19ae0 tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:53:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" by "attach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" acquired by "attach_volume" :: waited 0.072s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:15 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Attaching volume bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 to instance 2bf9f5be-91ba-41e7-8a2d-c4ede6f24435 at mountpoint /dev/vdb on host None.
Sep 24 17:53:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Attach volume completed successfully.
Sep 24 17:53:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-75f06a07-21e1-48e2-a738-bb0de89c15d4 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" released by "attach_volume" :: held 0.564s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.272s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:17 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Terminate volume connection completed successfully.
Sep 24 17:53:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" by "detach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" acquired by "detach_volume" :: waited 0.165s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Detaching volume bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 from instance 2bf9f5be-91ba-41e7-8a2d-c4ede6f24435.
Sep 24 17:53:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Detach volume completed successfully.
Sep 24 17:53:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b1388b33-46d3-41d7-8376-26bca990dfad tempest-VolumesActionsTest-349384683 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" released by "detach_volume" :: held 0.459s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b0424d8f-7f50-454c-bcee-6374a17534c8 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" by "detach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b0424d8f-7f50-454c-bcee-6374a17534c8 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b0424d8f-7f50-454c-bcee-6374a17534c8 tempest-VolumesActionsTest-1091130200 None] Volume detach called, but volume not attached.
Sep 24 17:53:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b0424d8f-7f50-454c-bcee-6374a17534c8 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:21 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=42,cinder:SELECT=29,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:53:21 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-quobyte-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "cinder-quobyte-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" acquired by "delete_volume" :: waited 0.054s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[529760ab-a50f-4f1f-b224-9ab1daab5c5e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Flow 'volume_create_manager' (dae534a9-10c1-485f-ab50-ced9ba501fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32668bd-2806-48d8-b6ab-3e83ea8c10df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32668bd-2806-48d8-b6ab-3e83ea8c10df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664699740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29167414-c0df-4b8a-8195-10127b02c4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ce42fe94064ac1b26975b99d971b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:23Z,use_quota=True,user_id='d22cb110847d4b6cba397eaaa94c391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa8c124-2fb7-4557-b5a3-568c6e59ca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa8c124-2fb7-4557-b5a3-568c6e59ca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c797f8-f066-4bb8-96dc-a3b733905dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c797f8-f066-4bb8-96dc-a3b733905dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29167414-c0df-4b8a-8195-10127b02c4b8', 'volume_name': 'volume-29167414-c0df-4b8a-8195-10127b02c4b8', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ca074-3770-4c5e-ad3b-39118897f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ca074-3770-4c5e-ad3b-39118897f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dc200a-6d81-4886-8807-051f2e1db124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:23 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Volume 29167414-c0df-4b8a-8195-10127b02c4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29167414-c0df-4b8a-8195-10127b02c4b8', 'volume_size': 1}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-664699740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29167414-c0df-4b8a-8195-10127b02c4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6ce42fe94064ac1b26975b99d971b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:23Z,use_quota=True,user_id='d22cb110847d4b6cba397eaaa94c391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Creating volume 29167414-c0df-4b8a-8195-10127b02c4b8 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:23 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: System call of process 91188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:23 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=43, name=volume-29167414-c0df-4b8a-8195-10127b02c4b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" returned: 0 in 1.949s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8 1073741824" returned: 0 in 0.657s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" returned: 0 in 0.398s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "cinder-quobyte-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9" released by "delete_volume" :: held 2.735s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8" returned: 0 in 0.380s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] <== create_volume: return (1133ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96dc200a-6d81-4886-8807-051f2e1db124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29167414-c0df-4b8a-8195-10127b02c4b8', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad14000-0bcd-40ad-b09c-e6c09ee0011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:24 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Volume volume-29167414-c0df-4b8a-8195-10127b02c4b8 (29167414-c0df-4b8a-8195-10127b02c4b8): created successfully
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad14000-0bcd-40ad-b09c-e6c09ee0011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Flow 'volume_create_manager' (dae534a9-10c1-485f-ab50-ced9ba501fac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ef1f303e-c082-4564-ae32-895005d86220 tempest-VolumesServicesTestJSON-1583376463 None] Created volume successfully.
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Created reservations ['8e12b893-c1c8-4731-99ab-0ef52ddbefe2', '36abc2f6-9c39-4a53-b5ab-afad62240b3e', '43f007ab-7ece-4e7d-8342-20444fa54a72', '0c1c4c7b-08bf-4989-a2a7-de6ee3180a3d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.097s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Deleted volume successfully.
Sep 24 17:53:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f25b544b-c422-4e34-838d-ac7ea5b93f2c tempest-VolumesActionsTest-1091130200 None] Lock "cinder-bc2a77c2-77a9-45f8-8466-ddf4c37b99f9-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Acquiring lock "cinder-29167414-c0df-4b8a-8195-10127b02c4b8-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "cinder-29167414-c0df-4b8a-8195-10127b02c4b8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Acquiring lock "cinder-quobyte-29167414-c0df-4b8a-8195-10127b02c4b8" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "cinder-quobyte-29167414-c0df-4b8a-8195-10127b02c4b8" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1c2a2-c1ee-46f6-9c41-2992089d7194]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8" returned: 0 in 0.456s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-29167414-c0df-4b8a-8195-10127b02c4b8" returned: 0 in 0.324s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "cinder-quobyte-29167414-c0df-4b8a-8195-10127b02c4b8" released by "delete_volume" :: held 1.315s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:28 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Created reservations ['718e4e14-fa64-454b-92d4-c73e1f9b5741', 'd9614862-12c3-472e-bbe9-89069fc74680', 'c553c187-02a1-4aa0-8cd0-43b87e75557f', '16565bc9-18bd-4e9b-a239-61c4c4e7a7df'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.313s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Deleted volume successfully.
Sep 24 17:53:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-70372a09-507b-4f2c-9eaa-48fd67525647 tempest-VolumesServicesTestJSON-1583376463 None] Lock "cinder-29167414-c0df-4b8a-8195-10127b02c4b8-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (d88cc5fd-e427-4553-9470-61d1ac878ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc678c-d731-4973-9810-3104ad4e1ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbc678c-d731-4973-9810-3104ad4e1ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943922545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35389c44-3f37-4e74-b9c1-76461c232526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:36Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89914216-2ca4-43be-91cf-c5e022f851a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89914216-2ca4-43be-91cf-c5e022f851a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1333ac76-122b-4fc6-9f72-48771285f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1333ac76-122b-4fc6-9f72-48771285f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35389c44-3f37-4e74-b9c1-76461c232526', 'volume_name': 'volume-35389c44-3f37-4e74-b9c1-76461c232526', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2568b3a8-042c-49ef-bcaf-37220f7263d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2568b3a8-042c-49ef-bcaf-37220f7263d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563bd334-e81a-41fc-abe2-ddc70f5eb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Volume 35389c44-3f37-4e74-b9c1-76461c232526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35389c44-3f37-4e74-b9c1-76461c232526', 'volume_size': 1}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-943922545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35389c44-3f37-4e74-b9c1-76461c232526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:36Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Creating volume 35389c44-3f37-4e74-b9c1-76461c232526 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:36 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:36 devstack quobyte-client[84528]: System call of process 91285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:36 devstack quobyte-client[84528]: System call of process 91285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:36 devstack quobyte-client[84528]: System call of process 91285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:36 devstack quobyte-client[84528]: System call of process 91285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:36 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=44, name=volume-35389c44-3f37-4e74-b9c1-76461c232526, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526 1073741824" returned: 0 in 0.473s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526" returned: 0 in 0.283s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (838ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563bd334-e81a-41fc-abe2-ddc70f5eb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35389c44-3f37-4e74-b9c1-76461c232526', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758c7d41-eea2-4734-8c87-224ca7a89d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:37 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Volume volume-35389c44-3f37-4e74-b9c1-76461c232526 (35389c44-3f37-4e74-b9c1-76461c232526): created successfully
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758c7d41-eea2-4734-8c87-224ca7a89d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:37 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (d88cc5fd-e427-4553-9470-61d1ac878ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:37 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-525e1370-9b2a-4990-ae68-e2b4e0f321e0 tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:53:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-35389c44-3f37-4e74-b9c1-76461c232526-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "cinder-35389c44-3f37-4e74-b9c1-76461c232526-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-quobyte-35389c44-3f37-4e74-b9c1-76461c232526" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-35389c44-3f37-4e74-b9c1-76461c232526" acquired by "delete_volume" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af9cf14-efe1-4ccb-a4b9-1510dd5b7110]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:39 devstack quobyte-client[84528]: System call of process 91296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526" returned: 0 in 0.551s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-35389c44-3f37-4e74-b9c1-76461c232526" returned: 0 in 0.206s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-35389c44-3f37-4e74-b9c1-76461c232526" released by "delete_volume" :: held 0.999s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Created reservations ['607621ff-c013-4a1f-8777-e612f6adb3cd', '82c04a9a-21c9-4df2-8954-be34e508744c', 'ff3553b8-3dee-4e25-9e2c-3b1b3eee2ced', '513886d2-c208-4c65-aca8-e3b12e9ad736'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.166s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:40 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Deleted volume successfully.
Sep 24 17:53:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-746dfa11-2526-42f0-8edc-6fc5d817f871 tempest-VolumesActionsTest-349384683 None] Lock "cinder-35389c44-3f37-4e74-b9c1-76461c232526-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:41 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:41 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (8882f781-08f0-4858-a87e-54c191a4fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c632df31-07fb-404d-83ea-7ab7f41c5985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c632df31-07fb-404d-83ea-7ab7f41c5985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929060083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9ce91-0c43-44cb-afe2-0891cec1d5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:42Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563fe58a-a7e7-48d2-9442-816ec58a1516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563fe58a-a7e7-48d2-9442-816ec58a1516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b87d39-f69b-49de-85a7-ae136b0cb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b87d39-f69b-49de-85a7-ae136b0cb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a9ce91-0c43-44cb-afe2-0891cec1d5bd', 'volume_name': 'volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494fc7fc-7ffd-4fa9-a2b5-9c4667b91e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494fc7fc-7ffd-4fa9-a2b5-9c4667b91e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7006a285-f5c8-4928-9b33-11fc30070bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:42 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Volume a0a9ce91-0c43-44cb-afe2-0891cec1d5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd', 'volume_size': 1}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929060083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9ce91-0c43-44cb-afe2-0891cec1d5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:42Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Creating volume a0a9ce91-0c43-44cb-afe2-0891cec1d5bd {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:42 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:42 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=45, name=volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd 1073741824" returned: 0 in 0.514s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" returned: 0 in 0.216s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7006a285-f5c8-4928-9b33-11fc30070bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539cb638-0647-4bc1-8a18-d788b1df4554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:43 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Volume volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd (a0a9ce91-0c43-44cb-afe2-0891cec1d5bd): created successfully
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539cb638-0647-4bc1-8a18-d788b1df4554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (8882f781-08f0-4858-a87e-54c191a4fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4a1813f4-9636-4a57-85c9-f2fe670de0de tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "cinder-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-quobyte-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[442acf2e-e59f-4c7c-82da-94d98ac9adf2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:45 devstack quobyte-client[84528]: System call of process 91306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:45 devstack quobyte-client[84528]: System call of process 91306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" returned: 0 in 0.700s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" returned: 0 in 0.254s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd" released by "delete_volume" :: held 1.169s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Created reservations ['3c6df326-81b7-4b2b-8ac8-97066347ca26', '5f107fcd-8e4d-4fb7-b5ae-4a4a4eae7061', '542fc2c5-f44e-40c5-9bd3-e2e462b00dcd', '663fb4f8-4810-4f30-9c88-1dce1f20f559'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Deleted volume successfully.
Sep 24 17:53:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fd0238e9-8f45-476a-991a-ea424ca69630 tempest-VolumesActionsTest-349384683 None] Lock "cinder-a0a9ce91-0c43-44cb-afe2-0891cec1d5bd-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (ace725db-5aa6-4e2d-b191-4f25c1354f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95f4803-51f2-48b2-9d23-e6f9ad4bea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95f4803-51f2-48b2-9d23-e6f9ad4bea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-249732853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9179e325-e4d6-420a-8835-97f628551962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:48Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aaf037-fd2f-4f09-b74d-1826c03adccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aaf037-fd2f-4f09-b74d-1826c03adccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aada4f20-5c22-4eb5-aef3-449baa4f1855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aada4f20-5c22-4eb5-aef3-449baa4f1855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9179e325-e4d6-420a-8835-97f628551962', 'volume_name': 'volume-9179e325-e4d6-420a-8835-97f628551962', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8812a298-0a59-4f3e-88dc-90e5cd887c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8812a298-0a59-4f3e-88dc-90e5cd887c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55067f9-0f1a-473c-9456-e7e19b5e5ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:48 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Volume 9179e325-e4d6-420a-8835-97f628551962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9179e325-e4d6-420a-8835-97f628551962', 'volume_size': 1}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-249732853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9179e325-e4d6-420a-8835-97f628551962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:48Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Creating volume 9179e325-e4d6-420a-8835-97f628551962 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:48 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:48 devstack quobyte-client[84528]: System call of process 91314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:48 devstack quobyte-client[84528]: System call of process 91314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:48 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=46, name=volume-9179e325-e4d6-420a-8835-97f628551962, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962 1073741824" returned: 0 in 0.557s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962" returned: 0 in 0.167s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (844ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55067f9-0f1a-473c-9456-e7e19b5e5ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9179e325-e4d6-420a-8835-97f628551962', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266520a1-08b1-4df6-9dc9-e91c3b9b9322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:49 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Volume volume-9179e325-e4d6-420a-8835-97f628551962 (9179e325-e4d6-420a-8835-97f628551962): created successfully
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266520a1-08b1-4df6-9dc9-e91c3b9b9322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (ace725db-5aa6-4e2d-b191-4f25c1354f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e81f987c-681b-46b3-85db-064ce658e818 tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:53:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (b947e782-5eab-4a89-8bdc-3fd19e48e3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab1fb4a-5119-40f5-b5ed-67b522e67713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-9179e325-e4d6-420a-8835-97f628551962-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab1fb4a-5119-40f5-b5ed-67b522e67713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-544222465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67f5ddd-a57f-420c-89ac-da732c92ef9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:51Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da7c02c-7109-4952-ad78-2b0894dfb2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da7c02c-7109-4952-ad78-2b0894dfb2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5534aee2-c6b2-4875-baa5-10c5884dbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5534aee2-c6b2-4875-baa5-10c5884dbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67f5ddd-a57f-420c-89ac-da732c92ef9e', 'volume_name': 'volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badd780d-95e0-405a-8952-564cc397bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badd780d-95e0-405a-8952-564cc397bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609d539c-54a9-46c0-8352-311eab0ec9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:51 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Volume d67f5ddd-a57f-420c-89ac-da732c92ef9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e', 'volume_size': 1}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-544222465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67f5ddd-a57f-420c-89ac-da732c92ef9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:51Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Creating volume d67f5ddd-a57f-420c-89ac-da732c92ef9e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:51 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:51 devstack quobyte-client[84528]: System call of process 91323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "cinder-9179e325-e4d6-420a-8835-97f628551962-delete_volume" acquired by "delete_volume" :: waited 0.346s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:51 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=47, name=volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e 1073741824" returned: 0 in 0.696s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-quobyte-9179e325-e4d6-420a-8835-97f628551962" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e" returned: 0 in 0.479s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] <== create_volume: return (1208ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=48,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=11 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-9179e325-e4d6-420a-8835-97f628551962" acquired by "delete_volume" :: waited 0.310s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609d539c-54a9-46c0-8352-311eab0ec9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da8fb00-4dc2-4232-aefb-c6af148f3d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[38227eb6-1ea2-44bb-8f3e-aa1228c4f2e3]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Volume volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e (d67f5ddd-a57f-420c-89ac-da732c92ef9e): created successfully
Sep 24 17:53:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da8fb00-4dc2-4232-aefb-c6af148f3d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (b947e782-5eab-4a89-8bdc-3fd19e48e3f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fa5f3f92-e091-4ba3-a4d2-e92770b64710 tempest-AttachVolumeTestJSON-39313904 None] Created volume successfully.
Sep 24 17:53:53 devstack quobyte-client[84528]: System call of process 91327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:53 devstack quobyte-client[84528]: System call of process 91327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:53 devstack quobyte-client[84528]: System call of process 91327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:53 devstack quobyte-client[84528]: System call of process 91327 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962" returned: 0 in 1.246s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9179e325-e4d6-420a-8835-97f628551962" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-9179e325-e4d6-420a-8835-97f628551962" released by "delete_volume" :: held 1.624s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Created reservations ['6f198ef0-17c3-4819-b375-bd63f6688560', '9f781b56-5a70-4e66-ba6d-10109a6c72a0', '3c717d4f-e598-4ba2-9bec-add53bb61445', '38897fdf-4f99-41ce-bd92-e59ee8509677'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.106s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:55 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:53:55 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Deleted volume successfully.
Sep 24 17:53:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-46a5f2ec-5574-4335-b358-f0c0a8c75914 tempest-VolumesActionsTest-349384683 None] Lock "cinder-9179e325-e4d6-420a-8835-97f628551962-delete_volume" released by "delete_volume" :: held 3.964s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:53:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (76e9196d-9606-4b5e-a37d-f5a7a6d637ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e7e374-9474-4207-bff4-516d2d52dec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e7e374-9474-4207-bff4-516d2d52dec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196369161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c065516-d1c0-46d7-a46b-ec2c1708923f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:56Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85763714-9fbf-4787-b833-f2ad43d8b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85763714-9fbf-4787-b833-f2ad43d8b319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab22ed7-92b0-4335-b472-39f555fa04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab22ed7-92b0-4335-b472-39f555fa04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c065516-d1c0-46d7-a46b-ec2c1708923f', 'volume_name': 'volume-6c065516-d1c0-46d7-a46b-ec2c1708923f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27ef548-4bdc-4784-b32b-b9a089930e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27ef548-4bdc-4784-b32b-b9a089930e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1901efe6-c806-4b0f-b1ae-e22431826a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:56 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Volume 6c065516-d1c0-46d7-a46b-ec2c1708923f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c065516-d1c0-46d7-a46b-ec2c1708923f', 'volume_size': 1}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196369161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c065516-d1c0-46d7-a46b-ec2c1708923f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:53:56Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Creating volume 6c065516-d1c0-46d7-a46b-ec2c1708923f {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:53:56 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:56 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=48, name=volume-6c065516-d1c0-46d7-a46b-ec2c1708923f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f 1073741824" returned: 0 in 0.369s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f" returned: 0 in 0.176s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1901efe6-c806-4b0f-b1ae-e22431826a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c065516-d1c0-46d7-a46b-ec2c1708923f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54c6c88-b331-4217-8009-81b5b6f3953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:53:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Volume volume-6c065516-d1c0-46d7-a46b-ec2c1708923f (6c065516-d1c0-46d7-a46b-ec2c1708923f): created successfully
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54c6c88-b331-4217-8009-81b5b6f3953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:53:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (76e9196d-9606-4b5e-a37d-f5a7a6d637ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:53:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2bb770c5-aa6e-492d-9e33-70b3533ee762 tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:53:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:53:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:53:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae7ec85-d3cc-4b42-98b1-f8fd7cea783c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-6c065516-d1c0-46d7-a46b-ec2c1708923f-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "cinder-6c065516-d1c0-46d7-a46b-ec2c1708923f-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e" returned: 0 in 0.623s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.661s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:53:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Acquiring lock "cinder-quobyte-6c065516-d1c0-46d7-a46b-ec2c1708923f" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-6c065516-d1c0-46d7-a46b-ec2c1708923f" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49f73028-02fb-4c5a-8fd8-93287b36a454', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:53:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72be037-fbc6-4094-931e-523f3acf6a43]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:53:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:53:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-f6122933-4cc5-445e-9848-a65aa1985cc6 req-ef5235d7-7236-47fd-a35e-96fbd88fcdb9 tempest-AttachVolumeTestJSON-39313904 None] attachment_update completed successfully.
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:53:59 devstack quobyte-client[84528]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f" returned: 0 in 0.607s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6c065516-d1c0-46d7-a46b-ec2c1708923f" returned: 0 in 0.117s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "cinder-quobyte-6c065516-d1c0-46d7-a46b-ec2c1708923f" released by "delete_volume" :: held 0.872s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Created reservations ['1dec09b9-eb06-4bc8-a521-68dd6093118e', 'a81976f6-b0a7-4438-879b-1298076a62d4', 'a6b1a0d0-d91c-4f07-9b1e-c8a05c9596a5', '0c50055c-f1e6-4fa1-84e4-b6034ef645a5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.157s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:00 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:01 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Deleted volume successfully.
Sep 24 17:54:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-302cf8d7-c5e5-46f1-9ff2-4f9e3c5a97a3 tempest-VolumesActionsTest-349384683 None] Lock "cinder-6c065516-d1c0-46d7-a46b-ec2c1708923f-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (2e177a68-d7cc-474b-b611-2c084502d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2158d-4c8e-455c-aabe-4d5df795d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f2158d-4c8e-455c-aabe-4d5df795d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839525985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b5e8b8-44ed-4705-b7f6-3fec12295f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:02Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eaf970-155d-4cdb-b362-130f9c94b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3eaf970-155d-4cdb-b362-130f9c94b20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3cb765-2f68-4485-b065-6ce2694a008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3cb765-2f68-4485-b065-6ce2694a008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b5e8b8-44ed-4705-b7f6-3fec12295f77', 'volume_name': 'volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287069a7-b7aa-4026-9920-60626bbe9074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287069a7-b7aa-4026-9920-60626bbe9074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0193ae31-a4ed-418c-b1b5-810a710678a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:02 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Volume 62b5e8b8-44ed-4705-b7f6-3fec12295f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77', 'volume_size': 1}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1839525985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b5e8b8-44ed-4705-b7f6-3fec12295f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b62e4e1420dd444bbcabbc4efe0fc637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:02Z,use_quota=True,user_id='2087f4cfdcea46639bcd80ba3c006075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Creating volume 62b5e8b8-44ed-4705-b7f6-3fec12295f77 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:02 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:02 devstack quobyte-client[84528]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:02 devstack quobyte-client[84528]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:02 devstack quobyte-client[84528]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:02 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=49, name=volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 1073741824" returned: 0 in 0.551s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77" returned: 0 in 0.171s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0193ae31-a4ed-418c-b1b5-810a710678a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9fc253-56a0-47b9-bde0-abe79a0a4fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:03 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Volume volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 (62b5e8b8-44ed-4705-b7f6-3fec12295f77): created successfully
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b9fc253-56a0-47b9-bde0-abe79a0a4fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Flow 'volume_create_manager' (2e177a68-d7cc-474b-b611-2c084502d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0a400e6d-0dcf-4d94-ac81-6895404e4cd7 tempest-VolumesActionsTest-1091130200 None] Created volume successfully.
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-62b5e8b8-44ed-4705-b7f6-3fec12295f77-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-62b5e8b8-44ed-4705-b7f6-3fec12295f77-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:05 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "cinder-quobyte-62b5e8b8-44ed-4705-b7f6-3fec12295f77" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-quobyte-62b5e8b8-44ed-4705-b7f6-3fec12295f77" acquired by "delete_volume" :: waited 0.044s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d8dd14-82f0-468c-bb0c-1f7342092382]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:06 devstack quobyte-client[84528]: System call of process 91755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:06 devstack quobyte-client[84528]: System call of process 91755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:06 devstack quobyte-client[84528]: System call of process 91755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77" returned: 0 in 0.818s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-62b5e8b8-44ed-4705-b7f6-3fec12295f77" returned: 0 in 0.159s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:06 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-quobyte-62b5e8b8-44ed-4705-b7f6-3fec12295f77" released by "delete_volume" :: held 1.297s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Created reservations ['42fd5551-811d-4d70-8aa0-ac87663c9035', 'e767cf06-3919-4203-a2b2-52e26a73f0fd', 'ec42b52d-5adc-485b-a011-b1ba2a9d9dc4', '49d379b6-7c4a-403b-a092-beb7940e8c3c'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.196s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:07 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Deleted volume successfully.
Sep 24 17:54:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-749cc18d-c494-475a-995c-281a1638fe59 tempest-VolumesActionsTest-1091130200 None] Lock "cinder-62b5e8b8-44ed-4705-b7f6-3fec12295f77-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Flow 'volume_create_manager' (6f27f8c0-8233-413f-bb4c-a22b38e27832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42acd78-6ecb-45ce-84ad-80345d94b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42acd78-6ecb-45ce-84ad-80345d94b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1810569521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf010d9-6a3b-45de-bcd6-bdf7eaced608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0008af3215af4a19970b656ace5f6ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:09Z,use_quota=True,user_id='0585adf7af1a41c89c42c2391edbc923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2352a619-be64-4c5c-829a-467bf728523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2352a619-be64-4c5c-829a-467bf728523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c562dd-e952-43b4-8a71-cd18a122e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c562dd-e952-43b4-8a71-cd18a122e203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf010d9-6a3b-45de-bcd6-bdf7eaced608', 'volume_name': 'volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9108a5e1-6fda-4152-87c5-58b06fa7685e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9108a5e1-6fda-4152-87c5-58b06fa7685e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b05fd3-99c2-4b8e-8e38-5988d51f86a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Volume fdf010d9-6a3b-45de-bcd6-bdf7eaced608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608', 'volume_size': 1}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1810569521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf010d9-6a3b-45de-bcd6-bdf7eaced608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0008af3215af4a19970b656ace5f6ab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:09Z,use_quota=True,user_id='0585adf7af1a41c89c42c2391edbc923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Creating volume fdf010d9-6a3b-45de-bcd6-bdf7eaced608 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:09 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:09 devstack quobyte-client[84528]: System call of process 91763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:09 devstack quobyte-client[84528]: System call of process 91763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:09 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=50, name=volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 1073741824" returned: 0 in 0.570s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" returned: 0 in 0.167s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] <== create_volume: return (875ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b05fd3-99c2-4b8e-8e38-5988d51f86a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f20554-86c7-47f7-b951-3f7ed362409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Volume volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 (fdf010d9-6a3b-45de-bcd6-bdf7eaced608): created successfully
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f20554-86c7-47f7-b951-3f7ed362409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Flow 'volume_create_manager' (6f27f8c0-8233-413f-bb4c-a22b38e27832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:10 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-053fb4ae-f473-4e82-8c61-074bad9913a4 tempest-AbsoluteLimitsTests-579710496 None] Created volume successfully.
Sep 24 17:54:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Acquiring lock "cinder-fdf010d9-6a3b-45de-bcd6-bdf7eaced608-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "cinder-fdf010d9-6a3b-45de-bcd6-bdf7eaced608-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Acquiring lock "cinder-quobyte-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "cinder-quobyte-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3184578-6415-4fac-aa83-4f6cab97ea22]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" returned: 0 in 0.643s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" returned: 0 in 0.192s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "cinder-quobyte-fdf010d9-6a3b-45de-bcd6-bdf7eaced608" released by "delete_volume" :: held 1.116s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Created reservations ['d873d617-b74c-4895-abb1-d65fc7d5cadf', '9cbdc1e3-7307-4362-b798-732770e700ff', '8cdd7a64-d5ea-45df-bbdd-0f660172032f', 'd4b7f2f1-cf76-483e-8c0e-c70281800fed'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.414s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:14 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Deleted volume successfully.
Sep 24 17:54:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d38cc0ac-c55d-46b9-8d9a-c393e426b734 tempest-AbsoluteLimitsTests-579710496 None] Lock "cinder-fdf010d9-6a3b-45de-bcd6-bdf7eaced608-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.201s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:20 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (bad6d14e-8a29-4d8f-82af-19dec80624fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617f305e-5063-4b16-b9d3-0734dbc0902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617f305e-5063-4b16-b9d3-0734dbc0902c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-240601739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7176017f-ff27-4193-ab42-3a14f90ed725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104352375c24f56924a64b26ebdaba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:20Z,use_quota=True,user_id='320234dc077b49e3858754454ef26af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b85889-e983-4661-a6d1-1d49e3b51760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b85889-e983-4661-a6d1-1d49e3b51760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2edee9-1ff5-45d0-84f4-12636bb721bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2edee9-1ff5-45d0-84f4-12636bb721bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7176017f-ff27-4193-ab42-3a14f90ed725', 'volume_name': 'volume-7176017f-ff27-4193-ab42-3a14f90ed725', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4d8edf-dea7-45cc-812c-774089113864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa4d8edf-dea7-45cc-812c-774089113864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6985631a-35ef-4cdf-8969-5d1f9e4ab1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:20 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Volume 7176017f-ff27-4193-ab42-3a14f90ed725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7176017f-ff27-4193-ab42-3a14f90ed725', 'volume_size': 1}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-240601739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7176017f-ff27-4193-ab42-3a14f90ed725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104352375c24f56924a64b26ebdaba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:20Z,use_quota=True,user_id='320234dc077b49e3858754454ef26af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Creating volume 7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:20 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:21 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=51, name=volume-7176017f-ff27-4193-ab42-3a14f90ed725, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 1073741824" returned: 0 in 0.476s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725" returned: 0 in 0.209s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] <== create_volume: return (831ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6985631a-35ef-4cdf-8969-5d1f9e4ab1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7176017f-ff27-4193-ab42-3a14f90ed725', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b355f081-5df2-44e0-bdb0-d288c7a5f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:22 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Volume volume-7176017f-ff27-4193-ab42-3a14f90ed725 (7176017f-ff27-4193-ab42-3a14f90ed725): created successfully
Sep 24 17:54:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b355f081-5df2-44e0-bdb0-d288c7a5f72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (bad6d14e-8a29-4d8f-82af-19dec80624fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f037432c-d98b-498f-bf76-6028744788b5 tempest-VolumesDeleteCascade-32343955 None] Created volume successfully.
Sep 24 17:54:22 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=43,cinder:UPDATE=87,cinder:INSERT=13,cinder:DELETE=10 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:54:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Creating offline snapshot d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 of volume 7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3020cd1a-e5c4-48f1-9921-c87c01033cf8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:23 devstack quobyte-client[84528]: System call of process 91885 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725" returned: 0 in 0.756s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:24 devstack quobyte-client[84528]: System call of process 91953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:24 devstack quobyte-client[84528]: System call of process 91953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:24 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=52, name=volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 1G" returned: 0 in 0.388s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7176017f-ff27-4193-ab42-3a14f90ed725 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:24 devstack quobyte-client[84528]: System call of process 91956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img rebase -u -b volume-7176017f-ff27-4193-ab42-3a14f90ed725 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.217s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.112s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:54:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.183s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.info" returned: 0 in 0.212s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.info" returned: 0 in 0.135s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-00ac1ee9-41f8-44ed-8b0c-a2b599370dc7 tempest-VolumesDeleteCascade-32343955 None] Create snapshot completed successfully
Sep 24 17:54:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Creating offline snapshot 565be6d0-73c5-4f52-9071-e3dbf67eecb1 of volume 7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:54:26 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f308e6c5-f487-42a7-bc95-90ddade3ac8e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.576s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176017f-ff27-4193-ab42-3a14f90ed725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:54:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:27 devstack quobyte-client[84528]: System call of process 91974 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:27 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=54, name=volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 1G" returned: 0 in 0.482s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:28 devstack quobyte-client[84528]: System call of process 91980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:28 devstack quobyte-client[84528]: System call of process 91980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:28 devstack quobyte-client[84528]: System call of process 91980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img rebase -u -b volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.334s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.143s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.135s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3e730421-77ca-4054-be9d-050b4b0d4948 tempest-VolumesDeleteCascade-32343955 None] Create snapshot completed successfully
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-7176017f-ff27-4193-ab42-3a14f90ed725-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-7176017f-ff27-4193-ab42-3a14f90ed725-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Performing cascade delete. {{(pid=84502) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-565be6d0-73c5-4f52-9071-e3dbf67eecb1-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-565be6d0-73c5-4f52-9071-e3dbf67eecb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-565be6d0-73c5-4f52-9071-e3dbf67eecb1" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-565be6d0-73c5-4f52-9071-e3dbf67eecb1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Deleting offline snapshot 565be6d0-73c5-4f52-9071-e3dbf67eecb1 of volume 7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] snapshot_file for this snap is: volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[758934ff-8d03-4101-a0c8-0b6d3888ab79]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.590s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176017f-ff27-4193-ab42-3a14f90ed725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1297253-385c-4301-8ab2-6ecdbf0ffdc8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.590s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176017f-ff27-4193-ab42-3a14f90ed725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:54:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.453s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.565be6d0-73c5-4f52-9071-e3dbf67eecb1" returned: 0 in 0.891s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (e505c225-c0fc-4354-b42c-9188b56ccfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1477391f-93d6-42f7-b609-d3dfa722b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-565be6d0-73c5-4f52-9071-e3dbf67eecb1" released by "_delete_snapshot" :: held 3.346s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1477391f-93d6-42f7-b609-d3dfa722b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416315044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f1d3e-c202-4990-9a39-8794409ffc55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:32Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c536b479-6ea9-42b5-9f5b-d94f9e16589f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c536b479-6ea9-42b5-9f5b-d94f9e16589f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1bcf11-aa55-4d27-b22b-8635865b7760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1bcf11-aa55-4d27-b22b-8635865b7760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499f1d3e-c202-4990-9a39-8794409ffc55', 'volume_name': 'volume-499f1d3e-c202-4990-9a39-8794409ffc55', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6f58ac-ee5e-49df-90d5-c9e25fe4393b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6f58ac-ee5e-49df-90d5-c9e25fe4393b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cd9705-ba95-473d-b237-1eaff28e8b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:33 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Volume 499f1d3e-c202-4990-9a39-8794409ffc55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499f1d3e-c202-4990-9a39-8794409ffc55', 'volume_size': 1}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1416315044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499f1d3e-c202-4990-9a39-8794409ffc55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:32Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Creating volume 499f1d3e-c202-4990-9a39-8794409ffc55 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:33 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" released by "delete_snapshot" :: held 3.856s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:34 devstack quobyte-client[84528]: System call of process 92357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:34 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=55, name=volume-499f1d3e-c202-4990-9a39-8794409ffc55, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55 1073741824" returned: 0 in 1.330s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Created reservations ['e5b38ceb-b197-4cbb-8bd2-8b48ff9160d7', '3dfff163-78d1-46f6-b921-469e79a986e4', 'd30fe612-78e3-4eb3-8305-012c0774a1f7', 'e6796063-9dd2-4c12-bfba-ba0dd9ef396a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55" returned: 0 in 0.466s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] <== create_volume: return (1855ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cd9705-ba95-473d-b237-1eaff28e8b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499f1d3e-c202-4990-9a39-8794409ffc55', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29715173-405c-4d65-8416-de88b0e97898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Volume volume-499f1d3e-c202-4990-9a39-8794409ffc55 (499f1d3e-c202-4990-9a39-8794409ffc55): created successfully
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29715173-405c-4d65-8416-de88b0e97898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (e505c225-c0fc-4354-b42c-9188b56ccfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-31ed1f64-7299-49da-974c-8448fdfc6d2e tempest-VolumesListAdminTestJSON-117583294 None] Created volume successfully.
Sep 24 17:54:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Delete snapshot completed successfully.
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-565be6d0-73c5-4f52-9071-e3dbf67eecb1-delete_snapshot" released by "delete_snapshot" :: held 5.989s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Deleting offline snapshot d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 of volume 7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] snapshot_file for this snap is: volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd83c41-7790-4879-975f-c90604392fa3]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:37 devstack quobyte-client[84528]: System call of process 92386 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:37 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (a6d88355-0267-4ec8-872a-6f0be9c64264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26bcfaf-3ee1-40b5-9f1a-81717e463fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26bcfaf-3ee1-40b5-9f1a-81717e463fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-20301348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d87f59-1915-4488-b819-f28922e5b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:37Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b345ffe-3601-415c-a975-cf3959864162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b345ffe-3601-415c-a975-cf3959864162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3021e54-d2b2-4ccd-afc3-a2816f06b4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3021e54-d2b2-4ccd-afc3-a2816f06b4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d87f59-1915-4488-b819-f28922e5b758', 'volume_name': 'volume-e3d87f59-1915-4488-b819-f28922e5b758', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe39c6-c2ff-4273-8a93-ff0b02e7ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fe39c6-c2ff-4273-8a93-ff0b02e7ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570b7e37-dec5-47c6-b3cc-4f2ea28f6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:38 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Volume e3d87f59-1915-4488-b819-f28922e5b758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d87f59-1915-4488-b819-f28922e5b758', 'volume_size': 1}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-20301348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d87f59-1915-4488-b819-f28922e5b758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:37Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Creating volume e3d87f59-1915-4488-b819-f28922e5b758 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:38 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:38 devstack quobyte-client[84528]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:38 devstack quobyte-client[84528]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:38 devstack quobyte-client[84528]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:38 devstack quobyte-client[84528]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:38 devstack quobyte-client[84528]: System call of process 92395 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:38 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=56, name=volume-e3d87f59-1915-4488-b819-f28922e5b758, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 2.045s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7176017f-ff27-4193-ab42-3a14f90ed725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85e91bf-7fd0-4fcd-bf92-a08df9e148b0]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758 1073741824" returned: 0 in 1.001s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758" returned: 0 in 0.179s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] <== create_volume: return (1255ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570b7e37-dec5-47c6-b3cc-4f2ea28f6c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d87f59-1915-4488-b819-f28922e5b758', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84398629-5530-46bd-b7a6-c7df8a898c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725" returned: 0 in 0.779s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:40 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Volume volume-e3d87f59-1915-4488-b819-f28922e5b758 (e3d87f59-1915-4488-b819-f28922e5b758): created successfully
Sep 24 17:54:40 devstack quobyte-client[84528]: System call of process 92408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:40 devstack quobyte-client[84528]: System call of process 92408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:40 devstack quobyte-client[84528]: System call of process 92408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:40 devstack quobyte-client[84528]: System call of process 92408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84398629-5530-46bd-b7a6-c7df8a898c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (a6d88355-0267-4ec8-872a-6f0be9c64264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5fa1f9db-33e2-46eb-8248-5e5a562cb35d tempest-VolumesListAdminTestJSON-117583294 None] Created volume successfully.
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.470s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725.d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" returned: 0 in 0.199s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0" released by "_delete_snapshot" :: held 4.064s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" released by "delete_snapshot" :: held 4.113s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Created reservations ['21ba8cc1-b531-46d9-9656-e46ed0bad57c', '7a0e6338-8154-4eb0-af7d-2586c22d4028', '47eeb853-3f5d-4528-a51e-af1b642c91a9', 'a6b39ade-3868-471c-a5be-9b912158cac7'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Delete snapshot completed successfully.
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-d7d1e659-c328-4ce3-bf9b-71343fc9ccc0-delete_snapshot" released by "delete_snapshot" :: held 4.811s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Snapshots deleted, issuing volume delete {{(pid=84502) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1390b-a957-4e71-b423-b6985394c23d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (28acdaa4-5107-48b4-9a8c-9d768617fe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed661ca-07f5-40cb-968e-08d7946106c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725" returned: 0 in 1.014s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed661ca-07f5-40cb-968e-08d7946106c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1855438116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e6f921-3d65-4f8a-82b1-075f2adb9e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:42Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a1e259-a30b-47a7-8b96-a412b8087e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a1e259-a30b-47a7-8b96-a412b8087e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca4a939-d767-4f92-a2b3-7e97d68dd8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca4a939-d767-4f92-a2b3-7e97d68dd8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e6f921-3d65-4f8a-82b1-075f2adb9e69', 'volume_name': 'volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1b0d7b-f4d4-4ed7-b8c5-25c83968f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1b0d7b-f4d4-4ed7-b8c5-25c83968f78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044e5741-dbfb-4397-b8c2-8205a8055bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:42 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Volume 00e6f921-3d65-4f8a-82b1-075f2adb9e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69', 'volume_size': 1}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1855438116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e6f921-3d65-4f8a-82b1-075f2adb9e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f954df248c4299939ee3bbc36535a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:42Z,use_quota=True,user_id='00b1a906259940d091f8ad257876eee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Creating volume 00e6f921-3d65-4f8a-82b1-075f2adb9e69 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:42 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7176017f-ff27-4193-ab42-3a14f90ed725" returned: 0 in 0.490s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:42 devstack quobyte-client[84528]: System call of process 92417 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-7176017f-ff27-4193-ab42-3a14f90ed725" released by "delete_volume" :: held 1.756s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:43 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=57, name=volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 1073741824" returned: 0 in 0.684s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Created reservations ['dc32b53e-4254-4082-b758-320f8c61045d', '540fdcd0-4f5d-47c1-af54-fb959b73c56f', '59ad3834-7f75-4c17-baca-00c9a1195057', '2938991d-4a06-4447-b35e-42faf2a2dd19'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69" returned: 0 in 0.293s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] <== create_volume: return (1009ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044e5741-dbfb-4397-b8c2-8205a8055bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257c262d-723e-4864-a879-6dd0824ff617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:43 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Volume volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 (00e6f921-3d65-4f8a-82b1-075f2adb9e69): created successfully
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257c262d-723e-4864-a879-6dd0824ff617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Flow 'volume_create_manager' (28acdaa4-5107-48b4-9a8c-9d768617fe9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ba22009b-efba-4b76-94f3-16b0997a6b3d tempest-VolumesListAdminTestJSON-117583294 None] Created volume successfully.
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Deleted volume successfully.
Sep 24 17:54:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3f61c528-0df7-440f-b8a4-2c0372aa15f7 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-7176017f-ff27-4193-ab42-3a14f90ed725-delete_volume" released by "delete_volume" :: held 14.300s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (eb62f7bf-e27c-4d27-b216-f78bff839b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2595fc42-ac96-47aa-9f2e-a9f17a0d128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2595fc42-ac96-47aa-9f2e-a9f17a0d128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726613413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d66711-8be8-44a1-ac1d-d1205d37535d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104352375c24f56924a64b26ebdaba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:45Z,use_quota=True,user_id='320234dc077b49e3858754454ef26af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89f9ab-d419-4650-8130-d2113fef8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef89f9ab-d419-4650-8130-d2113fef8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f9ed29-2a02-4186-92d1-64af0b911d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f9ed29-2a02-4186-92d1-64af0b911d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d66711-8be8-44a1-ac1d-d1205d37535d', 'volume_name': 'volume-48d66711-8be8-44a1-ac1d-d1205d37535d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c2481-6f95-40ba-a403-dcd29d517c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a98c2481-6f95-40ba-a403-dcd29d517c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1df78ec-653c-44fb-b57a-de37a44e17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:45 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Volume 48d66711-8be8-44a1-ac1d-d1205d37535d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d66711-8be8-44a1-ac1d-d1205d37535d', 'volume_size': 1}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726613413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d66711-8be8-44a1-ac1d-d1205d37535d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104352375c24f56924a64b26ebdaba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:45Z,use_quota=True,user_id='320234dc077b49e3858754454ef26af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Creating volume 48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:45 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:45 devstack quobyte-client[84528]: System call of process 92447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:45 devstack quobyte-client[84528]: System call of process 92447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:45 devstack quobyte-client[84528]: System call of process 92447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:45 devstack quobyte-client[84528]: System call of process 92447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:45 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=58, name=volume-48d66711-8be8-44a1-ac1d-d1205d37535d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d 1073741824" returned: 0 in 0.469s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Flow 'volume_create_manager' (776a18a2-38ac-4788-8cde-27ed3e5c0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115c6444-8240-4dc6-b145-58d52ea15998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115c6444-8240-4dc6-b145-58d52ea15998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45eb7d2a-9d25-4e3d-b245-0a6115fee54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca36ff644849938c3857803c80da10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:46Z,use_quota=True,user_id='b8714455481549949a778ed500e5746c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91059dca-0cd5-491a-bf33-b48abb2da832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91059dca-0cd5-491a-bf33-b48abb2da832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e822b3f-7c71-4707-840b-a22e916bfcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e822b3f-7c71-4707-840b-a22e916bfcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45eb7d2a-9d25-4e3d-b245-0a6115fee54d', 'volume_name': 'volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f3f7ce-d3db-4349-9389-5026c76c3655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f3f7ce-d3db-4349-9389-5026c76c3655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f5b2e7-b024-47e6-a870-5d517306f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Volume 45eb7d2a-9d25-4e3d-b245-0a6115fee54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d', 'volume_size': 1}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 0.555s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] <== create_volume: return (1054ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45eb7d2a-9d25-4e3d-b245-0a6115fee54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca36ff644849938c3857803c80da10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:46Z,use_quota=True,user_id='b8714455481549949a778ed500e5746c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Creating volume 45eb7d2a-9d25-4e3d-b245-0a6115fee54d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:46 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:54:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:46 devstack quobyte-client[84528]: System call of process 92451 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:47 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=59, name=volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1df78ec-653c-44fb-b57a-de37a44e17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d66711-8be8-44a1-ac1d-d1205d37535d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a18678f-dfb5-45bd-a6fe-10652780dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Volume volume-48d66711-8be8-44a1-ac1d-d1205d37535d (48d66711-8be8-44a1-ac1d-d1205d37535d): created successfully
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a18678f-dfb5-45bd-a6fe-10652780dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (eb62f7bf-e27c-4d27-b216-f78bff839b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d 1073741824" returned: 0 in 0.468s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-41c19dc0-e0df-45c2-a5ff-fdf71b9c6bf2 tempest-VolumesDeleteCascade-32343955 None] Created volume successfully.
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" returned: 0 in 0.273s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] <== create_volume: return (765ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f5b2e7-b024-47e6-a870-5d517306f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fca0f6-b763-47e0-8f80-810b15e36819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Volume volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d (45eb7d2a-9d25-4e3d-b245-0a6115fee54d): created successfully
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fca0f6-b763-47e0-8f80-810b15e36819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Flow 'volume_create_manager' (776a18a2-38ac-4788-8cde-27ed3e5c0b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-790db051-044f-4ab8-8a6e-a3333b8b68e2 tempest-VolumesListAdminTestJSON-1208990067 None] Created volume successfully.
Sep 24 17:54:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Creating offline snapshot 98f16c38-d7a2-472a-866b-c33780a73ec8 of volume 48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba16c1-f502-4292-9e0a-5ccb307780a0]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Acquiring lock "cinder-45eb7d2a-9d25-4e3d-b245-0a6115fee54d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-00e6f921-3d65-4f8a-82b1-075f2adb9e69-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "cinder-45eb7d2a-9d25-4e3d-b245-0a6115fee54d-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-00e6f921-3d65-4f8a-82b1-075f2adb9e69-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:48 devstack quobyte-client[84528]: System call of process 92455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:48 devstack quobyte-client[84528]: System call of process 92455 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 0.861s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:49 devstack quobyte-client[84528]: System call of process 92458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:49 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=60, name=volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-quobyte-00e6f921-3d65-4f8a-82b1-075f2adb9e69" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Acquiring lock "cinder-quobyte-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 1G" returned: 0 in 0.515s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img rebase -u -b volume-48d66711-8be8-44a1-ac1d-d1205d37535d -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:49 devstack quobyte-client[84528]: System call of process 92461 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-00e6f921-3d65-4f8a-82b1-075f2adb9e69" acquired by "delete_volume" :: waited 0.256s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img rebase -u -b volume-48d66711-8be8-44a1-ac1d-d1205d37535d -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.321s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b820e40-a98e-4109-8aa8-ebdc325edb98]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "cinder-quobyte-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" acquired by "delete_volume" :: waited 0.486s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[43066948-4358-408a-88c1-29ec7bf1163f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.431s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:50 devstack quobyte-client[84528]: System call of process 92465 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:50 devstack quobyte-client[84528]: System call of process 92466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:50 devstack quobyte-client[84528]: System call of process 92466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69" returned: 0 in 0.843s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.526s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-00e6f921-3d65-4f8a-82b1-075f2adb9e69" returned: 0 in 0.291s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" returned: 0 in 1.079s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.info" returned: 0 in 0.304s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-00e6f921-3d65-4f8a-82b1-075f2adb9e69" released by "delete_volume" :: held 1.817s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" returned: 0 in 0.413s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.info" returned: 0 in 0.346s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.737s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "cinder-quobyte-45eb7d2a-9d25-4e3d-b245-0a6115fee54d" released by "delete_volume" :: held 1.815s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:51 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b3e2e3a5-945a-40ca-ae28-f5da218793c9 tempest-VolumesDeleteCascade-32343955 None] Create snapshot completed successfully
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Created reservations ['71008799-6c23-430c-878a-ac5fb5e6869e', 'f40c5c2b-9959-446f-b26c-d71a1c32fdfa', 'ee56a437-5390-4adf-85d5-b0698a359d18', '7578b56a-f1f3-4f0d-8ef5-6ddae1c34d2b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Created reservations ['e7c04e04-45e9-47c8-8f30-206c23686190', 'ade1b2b8-7de7-4a18-8ded-f35b5161daaf', '308c701f-f61b-4665-b3ac-52c58af2dea4', '8f695874-aed9-4ce4-b4ca-56473a65608c'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.386s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:52 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Deleted volume successfully.
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.613s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Deleted volume successfully.
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-178ebf62-91e6-4b5b-abb7-9e027b027ab6 tempest-VolumesListAdminTestJSON-1208990067 None] Lock "cinder-45eb7d2a-9d25-4e3d-b245-0a6115fee54d-delete_volume" released by "delete_volume" :: held 4.548s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-44275fe1-4b15-4964-b149-23b19faca8cd tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-00e6f921-3d65-4f8a-82b1-075f2adb9e69-delete_volume" released by "delete_volume" :: held 4.646s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=60,cinder:INSERT=16,cinder:UPDATE=94,cinder:DELETE=10 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-e3d87f59-1915-4488-b819-f28922e5b758-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-e3d87f59-1915-4488-b819-f28922e5b758-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:54:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-quobyte-e3d87f59-1915-4488-b819-f28922e5b758" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (892bd64f-3eb9-4dc0-9e9d-ea926a990862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd527e-ffd3-446f-b397-4845bd7d5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd527e-ffd3-446f-b397-4845bd7d5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-229470840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4808d0ee-cc0a-4ab6-9d86-da5d40e14459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104352375c24f56924a64b26ebdaba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98f16c38-d7a2-472a-866b-c33780a73ec8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:54:53Z,use_quota=True,user_id='320234dc077b49e3858754454ef26af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572d33d2-ed4c-4197-b6cf-e97377ff36a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572d33d2-ed4c-4197-b6cf-e97377ff36a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd44db-d687-4822-a045-aab2ebb45069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76dd44db-d687-4822-a045-aab2ebb45069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4808d0ee-cc0a-4ab6-9d86-da5d40e14459', 'volume_name': 'volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459', 'volume_size': 1, 'snapshot_id': '98f16c38-d7a2-472a-866b-c33780a73ec8'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7293e6d7-1828-4e53-99b6-660a73cf380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7293e6d7-1828-4e53-99b6-660a73cf380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263fc949-a1d7-4190-a8fb-68cd3a958e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:54:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Volume 4808d0ee-cc0a-4ab6-9d86-da5d40e14459: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459', 'volume_size': 1, 'snapshot_id': '98f16c38-d7a2-472a-866b-c33780a73ec8'}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-e3d87f59-1915-4488-b819-f28922e5b758" acquired by "delete_volume" :: waited 0.106s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" by "_create_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f1e22-eea7-4dc8-90fd-ce4d8ae344bf]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" acquired by "_create_volume_from_snapshot" :: waited 0.128s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Creating volume 4808d0ee-cc0a-4ab6-9d86-da5d40e14459 from snapshot 98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" by "_copy_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" acquired by "_copy_volume_from_snapshot" :: waited 0.108s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] snapshot: 98f16c38-d7a2-472a-866b-c33780a73ec8, volume: 4808d0ee-cc0a-4ab6-9d86-da5d40e14459,  {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b4c26-556d-4b95-9397-3753d020cc4a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758" returned: 0 in 0.871s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3d87f59-1915-4488-b819-f28922e5b758" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-e3d87f59-1915-4488-b819-f28922e5b758" released by "delete_volume" :: held 1.227s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.796s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d66711-8be8-44a1-ac1d-d1205d37535d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Creating direct copy from snapshot {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d604be8-9509-4e00-ade0-d866f843d40e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Created reservations ['957dbe1d-6ca4-49be-bca5-4b14353abb37', '52da8d01-befc-464d-bc94-3e9000e3d985', '7f37b684-f4b0-4416-bdb0-c8fe4c5f6d37', '40e007b5-8464-4185-b8a1-0a3eb8ee0db0'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:54:56 devstack quobyte-client[84528]: System call of process 92487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 0.946s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.utils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 not found in is_blk_device check {{(pid=84502) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.215s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:54:56 devstack quobyte-client[84528]: System call of process 92497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:56 devstack quobyte-client[84528]: System call of process 92497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:56 devstack quobyte-client[84528]: System call of process 92497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:54:56 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Deleted volume successfully.
Sep 24 17:54:56 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=62, name=volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:54:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-add76343-e22b-4440-ab21-2c9a5557f9e9 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-e3d87f59-1915-4488-b819-f28922e5b758-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:54:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-499f1d3e-c202-4990-9a39-8794409ffc55-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-499f1d3e-c202-4990-9a39-8794409ffc55-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:54:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "cinder-quobyte-499f1d3e-c202-4990-9a39-8794409ffc55" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:54:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-499f1d3e-c202-4990-9a39-8794409ffc55" acquired by "delete_volume" :: waited 0.059s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:54:59 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6278e0c-fe8c-43b5-bb67-2b664f98e0d2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:54:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:00 devstack quobyte-client[84528]: System call of process 92507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:00 devstack quobyte-client[84528]: System call of process 92507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:00 devstack quobyte-client[84528]: System call of process 92507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55" returned: 0 in 1.993s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-499f1d3e-c202-4990-9a39-8794409ffc55" returned: 0 in 0.596s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-quobyte-499f1d3e-c202-4990-9a39-8794409ffc55" released by "delete_volume" :: held 3.493s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:04 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Created reservations ['b0ce8d72-3f66-4315-81d9-839bfc74926b', 'be846f9b-f21b-4166-8929-fc6c19d1be33', 'fe8cffe7-f25a-4be1-accf-5160e53531e7', '0528278a-c7f9-4fe2-bf89-f8405bceed0b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.131s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.213s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" returned: 0 in 10.570s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 1.008s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:07 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Deleted volume successfully.
Sep 24 17:55:07 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae397000-4764-43a5-9cfb-28f417f369e1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ea467fc0-72b3-419c-9176-ca34157fbe69 tempest-VolumesListAdminTestJSON-117583294 None] Lock "cinder-499f1d3e-c202-4990-9a39-8794409ffc55-delete_volume" released by "delete_volume" :: held 10.066s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 1.644s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:55:09 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Converted 1024.00 MB image at 95.70 MB/s
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" returned: 0 in 0.236s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" released by "_copy_volume_from_snapshot" :: held 15.476s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" released by "_create_volume_from_snapshot" :: held 15.699s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.834s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263fc949-a1d7-4190-a8fb-68cd3a958e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459', 'volume_size': 1, 'snapshot_id': '98f16c38-d7a2-472a-866b-c33780a73ec8'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4ec1c3-6fdc-494a-afbe-ce50601789b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Volume volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 (4808d0ee-cc0a-4ab6-9d86-da5d40e14459): created successfully
Sep 24 17:55:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4ec1c3-6fdc-494a-afbe-ce50601789b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Flow 'volume_create_manager' (892bd64f-3eb9-4dc0-9e9d-ea926a990862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:10 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6b7f914e-3f77-4a50-9286-6c1e614d9202 tempest-VolumesDeleteCascade-32343955 None] Created volume successfully.
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-48d66711-8be8-44a1-ac1d-d1205d37535d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-48d66711-8be8-44a1-ac1d-d1205d37535d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Performing cascade delete. {{(pid=84502) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-98f16c38-d7a2-472a-866b-c33780a73ec8-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-98f16c38-d7a2-472a-866b-c33780a73ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Deleting offline snapshot 98f16c38-d7a2-472a-866b-c33780a73ec8 of volume 48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] snapshot_file for this snap is: volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dfbea3-5c69-442b-8bea-5e430ad694d4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:12 devstack quobyte-client[84528]: System call of process 92756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.664s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48d66711-8be8-44a1-ac1d-d1205d37535d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe03bac-c83d-40e5-87b4-89b33dde295a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 0.665s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:13 devstack quobyte-client[84528]: System call of process 92770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.301s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d.98f16c38-d7a2-472a-866b-c33780a73ec8" returned: 0 in 0.197s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-98f16c38-d7a2-472a-866b-c33780a73ec8" released by "_delete_snapshot" :: held 2.297s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" released by "delete_snapshot" :: held 2.373s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Created reservations ['5473d6a5-f92c-41dd-ba62-96e932d8d6d2', '48587561-7941-4b41-9ff4-dba96fef79b9', '1d16b429-c52f-48af-a144-8523ece4c9e5', '40e016dd-3d1e-4cd4-8ab4-ecb9cd4e4614'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Delete snapshot completed successfully.
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-98f16c38-d7a2-472a-866b-c33780a73ec8-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Snapshots deleted, issuing volume delete {{(pid=84502) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 24 17:55:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" acquired by "delete_volume" :: waited 0.069s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[6500fb4b-c440-476d-b589-264c751ceef7]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 1.347s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.262s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-48d66711-8be8-44a1-ac1d-d1205d37535d" returned: 0 in 0.228s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-48d66711-8be8-44a1-ac1d-d1205d37535d" released by "delete_volume" :: held 1.882s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Created reservations ['f6e50d8a-cd81-441a-9234-367531ae3441', '24a2aa39-3054-498d-b64b-682367cf9992', '0bd42a5c-c954-4953-811a-2c1e98ff0786', '4f730e66-f532-4a46-a176-f515a2ef83da'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.134s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Deleted volume successfully.
Sep 24 17:55:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-21f1d7de-ad7f-47db-a0ef-0a39ca65a36a tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-48d66711-8be8-44a1-ac1d-d1205d37535d-delete_volume" released by "delete_volume" :: held 6.189s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-4808d0ee-cc0a-4ab6-9d86-da5d40e14459-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-4808d0ee-cc0a-4ab6-9d86-da5d40e14459-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" acquired by "delete_volume" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e46434-6b65-4496-ad4f-c98b36323282]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" returned: 0 in 0.565s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" returned: 0 in 0.175s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-quobyte-4808d0ee-cc0a-4ab6-9d86-da5d40e14459" released by "delete_volume" :: held 1.038s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Created reservations ['1738c8e9-c768-4682-8421-03dcec54b93c', '1c646157-afe2-4933-84f5-dfa457e26a78', 'f2566e24-acbd-494f-819f-4113094aeb45', 'b926eee9-efd6-4d53-b4ca-661e6f4595b5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.151s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:20 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Deleted volume successfully.
Sep 24 17:55:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19c065ba-0708-47ce-917a-d35e8e11c60c tempest-VolumesDeleteCascade-32343955 None] Lock "cinder-4808d0ee-cc0a-4ab6-9d86-da5d40e14459-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:21 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Flow 'volume_create_manager' (cb55de62-0200-445e-9e79-f94154bd24ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf7ee7b-1f2f-453e-adcc-e689a7a1017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf7ee7b-1f2f-453e-adcc-e689a7a1017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1973433101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbd89d-ff81-453a-8c2b-bd2b4d504d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eba04ff10ac4906a4d2882ac7e0fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:21Z,use_quota=True,user_id='e961150a00e246e1810eae7ef45d9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0a1fe9-ed00-48b2-828e-5e752dd0e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0a1fe9-ed00-48b2-828e-5e752dd0e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b92740d-2f2e-4074-b449-3251bc87beea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b92740d-2f2e-4074-b449-3251bc87beea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6bbd89d-ff81-453a-8c2b-bd2b4d504d78', 'volume_name': 'volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b86512080>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff604cf6-8a74-4d94-95fb-9054724e1736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff604cf6-8a74-4d94-95fb-9054724e1736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f1e690-2261-4b18-b89b-5fa65320db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:21 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b86512080>}
Sep 24 17:55:21 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Cloning c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 from image a414f1aa-0123-4732-9dda-73666cba7ecf  at location (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 17:55:22 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 17:55:22 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Image download 20.69 MB at 20.69 MB/s
Sep 24 17:55:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b481cc-ef64-4b47-ab95-dce13e888071]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:23 devstack sudo[92821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD
Sep 24 17:55:23 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:55:25 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root
Sep 24 17:55:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD" returned: 0 in 2.564s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:25 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf is fetched for user e961150a00e246e1810eae7ef45d9836. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 17:55:25 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=77,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=21 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:55:25 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca624ad5-166f-41a2-bcdc-f53f7e47f7aa]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:26 devstack sudo[92826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD
Sep 24 17:55:26 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:55:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Flow 'volume_create_manager' (7e9270e3-c3cf-44a7-97cf-a903d6d7ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72239d7d-7e58-4729-9e62-ce67e62d6af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72239d7d-7e58-4729-9e62-ce67e62d6af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-902644287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4257b05f-e960-4944-947c-2735c10a7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162d87357444c3c9c30917520d71818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:26Z,use_quota=True,user_id='49d33cbd79c1458583df72642665bb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3627326c-9c86-4c15-9d59-9807784dd8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3627326c-9c86-4c15-9d59-9807784dd8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83a888-94b3-487c-83cd-2c7bc9a7577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b83a888-94b3-487c-83cd-2c7bc9a7577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4257b05f-e960-4944-947c-2735c10a7ec1', 'volume_name': 'volume-4257b05f-e960-4944-947c-2735c10a7ec1', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94078572-0d5a-48da-b52a-91b67be6d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94078572-0d5a-48da-b52a-91b67be6d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361141a-77d4-4a87-ba30-568cde913332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Volume 4257b05f-e960-4944-947c-2735c10a7ec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4257b05f-e960-4944-947c-2735c10a7ec1', 'volume_size': 1}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-902644287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4257b05f-e960-4944-947c-2735c10a7ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162d87357444c3c9c30917520d71818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:26Z,use_quota=True,user_id='49d33cbd79c1458583df72642665bb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Creating volume 4257b05f-e960-4944-947c-2735c10a7ec1 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:55:26 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:55:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:27 devstack quobyte-client[84528]: System call of process 92828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:27 devstack quobyte-client[84528]: System call of process 92828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:27 devstack quobyte-client[84528]: System call of process 92828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:27 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=63, name=volume-4257b05f-e960-4944-947c-2735c10a7ec1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1 1073741824" returned: 0 in 0.447s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1" returned: 0 in 0.160s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] <== create_volume: return (698ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:55:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0361141a-77d4-4a87-ba30-568cde913332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4257b05f-e960-4944-947c-2735c10a7ec1', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3017ce14-71fa-424f-a4a6-8abf4e66e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:28 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Volume volume-4257b05f-e960-4944-947c-2735c10a7ec1 (4257b05f-e960-4944-947c-2735c10a7ec1): created successfully
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3017ce14-71fa-424f-a4a6-8abf4e66e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Flow 'volume_create_manager' (7e9270e3-c3cf-44a7-97cf-a903d6d7ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c3fc22e5-d783-4ef4-ad45-326cc5a29b81 tempest-VolumesTransfersV357Test-1723834244 None] Created volume successfully.
Sep 24 17:55:28 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD" returned: 0 in 2.674s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1973433101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6bbd89d-ff81-453a-8c2b-bd2b4d504d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eba04ff10ac4906a4d2882ac7e0fb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:21Z,use_quota=True,user_id='e961150a00e246e1810eae7ef45d9836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Creating volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:55:28 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:28 devstack quobyte-client[84528]: System call of process 92835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:28 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=64, name=volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 1073741824" returned: 0 in 0.373s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 0 in 0.112s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] <== create_volume: return (576ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:55:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.592s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:29 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Attempting download of a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 17:55:29 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4147d556-62e2-4d10-bb4c-b743d868a87f]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_vidb8orh {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b2b0e9ef-7a61-4365-a59b-b465caa8f26a tempest-VolumesTransfersV357Test-1744245500 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b2b0e9ef-7a61-4365-a59b-b465caa8f26a tempest-VolumesTransfersV357Test-1744245500 None] Transfer volume completed successfully.
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_vidb8orh" returned: 0 in 0.699s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_vidb8orh {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_vidb8orh" returned: 1 in 0.372s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_vidb8orh' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f7b438-d45d-49c7-9c3b-94dbd741f4e7]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:30 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] a414f1aa-0123-4732-9dda-73666cba7ecf was qcow2, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:31 devstack quobyte-client[84528]: System call of process 92850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:31 devstack quobyte-client[84528]: System call of process 92850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:31 devstack quobyte-client[84528]: System call of process 92850 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:31 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=64, name=volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "cinder-4257b05f-e960-4944-947c-2735c10a7ec1-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-4257b05f-e960-4944-947c-2735c10a7ec1-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "cinder-quobyte-4257b05f-e960-4944-947c-2735c10a7ec1" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-quobyte-4257b05f-e960-4944-947c-2735c10a7ec1" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26c15ac-db7f-4793-b0e1-125831eac04b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 0 in 1.411s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_kfpl2tf1devstack@QuobyteHD, size 112.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:55:32 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Converted 112.00 MB image at 77.06 MB/s
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1" returned: 0 in 0.715s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 1G" returned: 0 in 0.229s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4257b05f-e960-4944-947c-2735c10a7ec1" returned: 0 in 0.161s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dff507-ef69-41d3-aedd-8508576c476d]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-quobyte-4257b05f-e960-4944-947c-2735c10a7ec1" released by "delete_volume" :: held 1.167s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:33 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Created reservations ['f3a16219-34d5-45d0-8434-1a029002f3a8', 'd5cbb704-df39-4a71-89a8-2daf3bd929a8', '470ab909-e117-4f39-8003-73b89f50f86d', '1d7e3294-777c-4559-abda-94b4c55d7f18'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:33 devstack quobyte-client[84528]: System call of process 92863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 0 in 0.628s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.055s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:34 devstack quobyte-client[84528]: System call of process 92865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:34 devstack quobyte-client[84528]: System call of process 92865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:34 devstack quobyte-client[84528]: System call of process 92865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:34 devstack quobyte-client[84528]: System call of process 92865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 1 in 1.014s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Downloaded image a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf for user e961150a00e246e1810eae7ef45d9836 is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Marking volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.508s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Deleted volume successfully.
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Copying metadata from image a414f1aa-0123-4732-9dda-73666cba7ecf to c6bbd89d-ff81-453a-8c2b-bd2b4d504d78. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Creating volume glance metadata for volume c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 backed by image a414f1aa-0123-4732-9dda-73666cba7ecf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 17:55:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Flow 'volume_create_manager' (fc01a112-2712-469f-8a0d-838484a748a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3101e71-e8a9-4d99-8bfb-f2b61a2d56a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c38fe29-6444-4cc3-a6c8-664bc1d4832f tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-4257b05f-e960-4944-947c-2735c10a7ec1-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3101e71-e8a9-4d99-8bfb-f2b61a2d56a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-605520479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d95c5-e41f-43d3-b6eb-4041d91abd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162d87357444c3c9c30917520d71818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:35Z,use_quota=True,user_id='49d33cbd79c1458583df72642665bb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963de6e1-805c-4075-bb41-c5fc9939932a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963de6e1-805c-4075-bb41-c5fc9939932a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfbf3eb-0ea1-43e7-b96f-8f9f11d65703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfbf3eb-0ea1-43e7-b96f-8f9f11d65703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769d95c5-e41f-43d3-b6eb-4041d91abd01', 'volume_name': 'volume-769d95c5-e41f-43d3-b6eb-4041d91abd01', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2528487-0bd7-43af-bbb2-97964d3d6f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2528487-0bd7-43af-bbb2-97964d3d6f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358a7ec-66a9-4dcb-aff9-4394b325f7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:35 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Volume 769d95c5-e41f-43d3-b6eb-4041d91abd01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769d95c5-e41f-43d3-b6eb-4041d91abd01', 'volume_size': 1}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-605520479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769d95c5-e41f-43d3-b6eb-4041d91abd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c162d87357444c3c9c30917520d71818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:35Z,use_quota=True,user_id='49d33cbd79c1458583df72642665bb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Creating volume 769d95c5-e41f-43d3-b6eb-4041d91abd01 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:55:35 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:35 devstack quobyte-client[84528]: System call of process 92870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:35 devstack quobyte-client[84528]: System call of process 92870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:35 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=65, name=volume-769d95c5-e41f-43d3-b6eb-4041d91abd01, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 1073741824" returned: 0 in 0.570s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f1e690-2261-4b18-b89b-5fa65320db4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b86512080>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2639ebcb-21d3-4f46-b7be-4a5008f4b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Volume volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 (c6bbd89d-ff81-453a-8c2b-bd2b4d504d78): created successfully
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2639ebcb-21d3-4f46-b7be-4a5008f4b26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Flow 'volume_create_manager' (cb55de62-0200-445e-9e79-f94154bd24ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01" returned: 0 in 0.361s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] <== create_volume: return (975ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-daa5b4ae-93ab-44d1-870e-8198ca1ce9f8 tempest-VolumesImageMetadata-2032353230 None] Created volume successfully.
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358a7ec-66a9-4dcb-aff9-4394b325f7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769d95c5-e41f-43d3-b6eb-4041d91abd01', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40722118-0c7d-43b9-bb06-4062fb4a2c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:36 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Volume volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 (769d95c5-e41f-43d3-b6eb-4041d91abd01): created successfully
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40722118-0c7d-43b9-bb06-4062fb4a2c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Flow 'volume_create_manager' (fc01a112-2712-469f-8a0d-838484a748a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8a8d3f6d-9794-47c3-a96c-35ed629ca08d tempest-VolumesTransfersV357Test-1723834244 None] Created volume successfully.
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Acquiring lock "cinder-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "cinder-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "cinder-769d95c5-e41f-43d3-b6eb-4041d91abd01-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-769d95c5-e41f-43d3-b6eb-4041d91abd01-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Acquiring lock "cinder-quobyte-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "cinder-quobyte-769d95c5-e41f-43d3-b6eb-4041d91abd01" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-quobyte-769d95c5-e41f-43d3-b6eb-4041d91abd01" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "cinder-quobyte-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" acquired by "delete_volume" :: waited 0.063s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d5ff8-6dce-442e-b97c-56e0896b775d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:38 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9ad05-995f-426a-9c29-2095c258b817]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:38 devstack quobyte-client[84528]: System call of process 92881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:38 devstack quobyte-client[84528]: System call of process 92881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01" returned: 0 in 0.971s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-769d95c5-e41f-43d3-b6eb-4041d91abd01" returned: 0 in 0.314s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:39 devstack quobyte-client[84528]: System call of process 92883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:39 devstack quobyte-client[84528]: System call of process 92883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:39 devstack quobyte-client[84528]: System call of process 92883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 0 in 1.235s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-quobyte-769d95c5-e41f-43d3-b6eb-4041d91abd01" released by "delete_volume" :: held 1.771s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:39 devstack quobyte-client[84528]: System call of process 92892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 1 in 0.649s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Created reservations ['83b7eabb-f8f8-46bc-97a1-b8fff1c01c02', '3b943a65-3501-4553-95a2-94438c04027b', 'f7c0e9a8-7e4f-46f6-b343-b1ffff47a5ae', '58f9a9ce-6a93-4134-a5e8-7b6000789b57'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" returned: 0 in 0.409s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "cinder-quobyte-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78" released by "delete_volume" :: held 2.700s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Created reservations ['2c843450-741d-4bff-bbda-2f11e0138993', '52e1e7de-6bfd-4527-967e-0dd8744d92d0', '59af024e-0b60-41e2-9fa4-e1d9cd6be922', '2902cbbf-c48e-4b7e-8221-877f3708013e'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.378s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Deleted volume successfully.
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.259s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ba196c43-3d81-40cb-8ce4-7c2ac37dec3e tempest-VolumesTransfersV357Test-839930336 None] Lock "cinder-769d95c5-e41f-43d3-b6eb-4041d91abd01-delete_volume" released by "delete_volume" :: held 4.089s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Deleted volume successfully.
Sep 24 17:55:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ed1d6e41-3361-4e2f-b5a8-55bc2ad57029 tempest-VolumesImageMetadata-2032353230 None] Lock "cinder-c6bbd89d-ff81-453a-8c2b-bd2b4d504d78-delete_volume" released by "delete_volume" :: held 4.424s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Flow 'volume_create_manager' (b546f674-3052-4a16-ace2-17fb074c56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9df32dc-1bb2-4698-9ece-dea44911b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9df32dc-1bb2-4698-9ece-dea44911b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865760558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8921389c-7332-497c-9906-d7029017092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbf716d9dc446b0ab224c355953db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:46Z,use_quota=True,user_id='e1de325d12f844ff8a636383747c9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a319942-fb03-4cc9-907f-40c442585cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a319942-fb03-4cc9-907f-40c442585cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d32c723-3a93-4218-9034-d4ff57f7442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d32c723-3a93-4218-9034-d4ff57f7442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8921389c-7332-497c-9906-d7029017092e', 'volume_name': 'volume-8921389c-7332-497c-9906-d7029017092e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dfb6d-b1f7-4ecc-a160-729b42a4a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605dfb6d-b1f7-4ecc-a160-729b42a4a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befe33bd-01bc-4c70-8095-1c337844a27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume 8921389c-7332-497c-9906-d7029017092e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8921389c-7332-497c-9906-d7029017092e', 'volume_size': 1}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-865760558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8921389c-7332-497c-9906-d7029017092e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbf716d9dc446b0ab224c355953db44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:46Z,use_quota=True,user_id='e1de325d12f844ff8a636383747c9f23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Creating volume 8921389c-7332-497c-9906-d7029017092e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:55:46 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:46 devstack quobyte-client[84528]: System call of process 92905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:46 devstack quobyte-client[84528]: System call of process 92905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:46 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=66, name=volume-8921389c-7332-497c-9906-d7029017092e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e 1073741824" returned: 0 in 0.498s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e" returned: 0 in 0.235s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] <== create_volume: return (820ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befe33bd-01bc-4c70-8095-1c337844a27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8921389c-7332-497c-9906-d7029017092e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24438c9a-09be-4b4f-ba25-c7b120e1737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume volume-8921389c-7332-497c-9906-d7029017092e (8921389c-7332-497c-9906-d7029017092e): created successfully
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24438c9a-09be-4b4f-ba25-c7b120e1737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Flow 'volume_create_manager' (b546f674-3052-4a16-ace2-17fb074c56ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3b74b17e-8a8b-47e2-89f8-b3b4b6ed4840 tempest-SnapshotMetadataTestJSON-1093495227 None] Created volume successfully.
Sep 24 17:55:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Creating offline snapshot 1528318e-eac3-409e-aa1b-c13b8ce06640 of volume 8921389c-7332-497c-9906-d7029017092e {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:55:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[110009b0-4d1e-44fe-918f-85ddd8b11f21]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:49 devstack quobyte-client[84528]: System call of process 92909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:49 devstack quobyte-client[84528]: System call of process 92909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:49 devstack quobyte-client[84528]: System call of process 92909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:49 devstack quobyte-client[84528]: System call of process 92909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e" returned: 0 in 0.785s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:50 devstack quobyte-client[84528]: System call of process 92915 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:50 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=67, name=volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 1G" returned: 0 in 0.684s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8921389c-7332-497c-9906-d7029017092e -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:50 devstack quobyte-client[84528]: System call of process 92919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "qemu-img rebase -u -b volume-8921389c-7332-497c-9906-d7029017092e -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.189s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:55:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.400s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Flow 'volume_create_manager' (c59e63ad-9273-48b6-af67-4ee96b150732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d86f5b3-bb5c-487f-888e-0ad737792303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.info" returned: 0 in 0.419s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:55:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d86f5b3-bb5c-487f-888e-0ad737792303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1238123583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03ee1c14c3840c897ba7b93d4b3246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:51Z,use_quota=True,user_id='ea879639f9434c90a0f1d32a00531173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7925fc0-3cc4-40a9-8a3c-d97ded531ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7925fc0-3cc4-40a9-8a3c-d97ded531ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4263e5e1-3da3-4824-ba10-99dd6c633ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4263e5e1-3da3-4824-ba10-99dd6c633ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323', 'volume_name': 'volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323', 'volume_size': 2}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0479d13-dd37-444d-8e82-e25987936403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0479d13-dd37-444d-8e82-e25987936403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a0e7e5-be1c-47dc-91b3-8cd8797122fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:52 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Volume a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323', 'volume_size': 2}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.info" returned: 0 in 0.294s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1238123583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d03ee1c14c3840c897ba7b93d4b3246a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:55:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:55:51Z,use_quota=True,user_id='ea879639f9434c90a0f1d32a00531173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Creating volume a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:55:52 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 2147483648 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:52 devstack quobyte-client[84528]: System call of process 92927 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:52 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=69, name=volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:55:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dca2ed88-8554-49c4-926a-d8c4dff96b4c tempest-SnapshotMetadataTestJSON-1093495227 None] Create snapshot completed successfully
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 2147483648" returned: 0 in 0.524s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a0e7e5-be1c-47dc-91b3-8cd8797122fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323', 'volume_size': 2}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe4853a-4f76-4849-9f0b-4f9e3974ff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:55:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Volume volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 (a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323): created successfully
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe4853a-4f76-4849-9f0b-4f9e3974ff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:55:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Flow 'volume_create_manager' (c59e63ad-9273-48b6-af67-4ee96b150732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:55:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b546d9f6-8180-4590-bdfe-2498db386ba4 tempest-VolumesCloneNegativeTest-1944268396 None] Created volume successfully.
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "cinder-1528318e-eac3-409e-aa1b-c13b8ce06640-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-1528318e-eac3-409e-aa1b-c13b8ce06640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:54 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "cinder-quobyte-1528318e-eac3-409e-aa1b-c13b8ce06640" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-1528318e-eac3-409e-aa1b-c13b8ce06640" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Deleting offline snapshot 1528318e-eac3-409e-aa1b-c13b8ce06640 of volume 8921389c-7332-497c-9906-d7029017092e {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] snapshot_file for this snap is: volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0256f251-0233-4d20-8083-6f5e99bf3997]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:54 devstack quobyte-client[84528]: System call of process 92931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Acquiring lock "cinder-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:54 devstack quobyte-client[84528]: System call of process 92931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:54 devstack quobyte-client[84528]: System call of process 92931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:54 devstack quobyte-client[84528]: System call of process 92931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.548s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8921389c-7332-497c-9906-d7029017092e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "cinder-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=54,cinder:INSERT=33,cinder:UPDATE=71,cinder:DELETE=10 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f19e8a-e1f7-4199-9664-d14b73df6e6f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:55 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Acquiring lock "cinder-quobyte-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "cinder-quobyte-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d78cd1-f083-49d0-876c-32d5a4889c45]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e" returned: 0 in 0.689s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:55 devstack quobyte-client[84528]: System call of process 92938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.294s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" returned: 0 in 0.630s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e.1528318e-eac3-409e-aa1b-c13b8ce06640" returned: 0 in 0.237s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" returned: 0 in 0.183s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-1528318e-eac3-409e-aa1b-c13b8ce06640" released by "_delete_snapshot" :: held 2.148s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "cinder-quobyte-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323" released by "delete_volume" :: held 0.943s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" released by "delete_snapshot" :: held 2.288s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Created reservations ['b42b1d18-f60c-4124-b8ec-16aca580fb2a', '59f9275c-99b9-49b5-a6cf-8f9ea23d148c', '9ad2d8d6-3514-4a35-ba25-659273511154', 'a779e65c-db31-4f2b-8c89-916217baa2ea'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Created reservations ['cfc2c9b3-7fa4-4957-8a1f-cca65f544452', '4599ee34-8f66-4b81-8390-8f8ee9f5ef9e', 'd0345972-26f0-4b47-b90a-685086e64f02', '8d287845-3a53-4ad4-8efc-964242916a7e'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:56 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Delete snapshot completed successfully.
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2aafe680-7865-4da4-81a5-5727b19f3630 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-1528318e-eac3-409e-aa1b-c13b8ce06640-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Deleted volume successfully.
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-16dbdac4-df56-4957-abcf-2d0bbe5df9aa tempest-VolumesCloneNegativeTest-1944268396 None] Lock "cinder-a82fc4c3-fe7f-4b6c-838f-03ae3d9a5323-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "cinder-8921389c-7332-497c-9906-d7029017092e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-8921389c-7332-497c-9906-d7029017092e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:57 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" acquired by "delete_volume" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecca7c2-b2ea-4426-b4ce-50199408cadb]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:55:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e" returned: 0 in 0.461s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8921389c-7332-497c-9906-d7029017092e" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-quobyte-8921389c-7332-497c-9906-d7029017092e" released by "delete_volume" :: held 0.838s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Created reservations ['180faed1-d175-4ed6-99ec-19fc4b3ca997', 'bc069398-97eb-4182-868a-8a7440e363c0', 'bef8a516-480e-4d6b-a1f5-00ca0447ed53', '328420d6-2b88-4bf8-a32e-ccfa1b355c9f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:55:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:55:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Deleted volume successfully.
Sep 24 17:55:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-395f03a9-3fa4-4231-9026-09b343353175 tempest-SnapshotMetadataTestJSON-1093495227 None] Lock "cinder-8921389c-7332-497c-9906-d7029017092e-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Flow 'volume_create_manager' (a9816890-787e-4701-94a2-0f4997aa5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db48e564-524d-4e83-9c97-28a65679d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db48e564-524d-4e83-9c97-28a65679d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-967558350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0617a30a-f345-4b6f-b4bb-b301e505ec16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6c3d982cea423481ddfc2e4ae28d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:01Z,use_quota=True,user_id='b2a64d9b4b6d4f6583af019f0bb537d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e491113-5127-476f-9e68-c72bfadf2936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e491113-5127-476f-9e68-c72bfadf2936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9532ecbe-f3cf-4d0e-a03a-b7e86fc32706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:00 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9532ecbe-f3cf-4d0e-a03a-b7e86fc32706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0617a30a-f345-4b6f-b4bb-b301e505ec16', 'volume_name': 'volume-0617a30a-f345-4b6f-b4bb-b301e505ec16', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b864e79a0>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c018155-377b-4c6a-be9d-4febb9e1a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c018155-377b-4c6a-be9d-4febb9e1a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7644659a-b878-43a9-9938-92553d9a702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:01 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Volume 0617a30a-f345-4b6f-b4bb-b301e505ec16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0617a30a-f345-4b6f-b4bb-b301e505ec16', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b864e79a0>}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Cloning 0617a30a-f345-4b6f-b4bb-b301e505ec16 from image a414f1aa-0123-4732-9dda-73666cba7ecf  at location (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 17:56:01 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 17:56:01 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Image download 20.69 MB at 20.69 MB/s
Sep 24 17:56:02 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ceb0c-07bc-4a12-8dda-5d5c724890b2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:02 devstack sudo[92958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD
Sep 24 17:56:02 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:56:04 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root
Sep 24 17:56:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD" returned: 0 in 2.128s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:04 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf is fetched for user b2a64d9b4b6d4f6583af019f0bb537d9. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 17:56:04 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505941c-e689-405b-b694-d7c2f4d17816]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:04 devstack sudo[92963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD
Sep 24 17:56:04 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:56:05 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Flow 'volume_create_manager' (16441a54-eaa8-4120-9afe-a0d4b73fd164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6151b72a-c969-4dc9-9960-b586cc71b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6151b72a-c969-4dc9-9960-b586cc71b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1184664503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd935d2-7b22-4045-9b29-403e18495fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42b3c827794e569bfe25564bc7fcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:05Z,use_quota=True,user_id='2be60d6e068744bcaf13bd99888aea56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee20020-5200-48b5-bfaf-eabf49809980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee20020-5200-48b5-bfaf-eabf49809980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445694c7-17d0-4ae0-85d2-b4d55f6c8864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445694c7-17d0-4ae0-85d2-b4d55f6c8864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd935d2-7b22-4045-9b29-403e18495fa0', 'volume_name': 'volume-7bd935d2-7b22-4045-9b29-403e18495fa0', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ed45d3-ec13-4d33-9abd-a29dacdb97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ed45d3-ec13-4d33-9abd-a29dacdb97ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a3ca7-6e33-4ed0-a62e-a919e2fb3c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:05 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Volume 7bd935d2-7b22-4045-9b29-403e18495fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd935d2-7b22-4045-9b29-403e18495fa0', 'volume_size': 1}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1184664503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd935d2-7b22-4045-9b29-403e18495fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42b3c827794e569bfe25564bc7fcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:05Z,use_quota=True,user_id='2be60d6e068744bcaf13bd99888aea56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Creating volume 7bd935d2-7b22-4045-9b29-403e18495fa0 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:05 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:05 devstack quobyte-client[84528]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:05 devstack quobyte-client[84528]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:05 devstack quobyte-client[84528]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:05 devstack quobyte-client[84528]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:05 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=70, name=volume-7bd935d2-7b22-4045-9b29-403e18495fa0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0 1073741824" returned: 0 in 0.436s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0" returned: 0 in 0.137s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] <== create_volume: return (667ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a3ca7-6e33-4ed0-a62e-a919e2fb3c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd935d2-7b22-4045-9b29-403e18495fa0', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10a6be-14cc-4caa-a2e1-177de4933e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:06 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Volume volume-7bd935d2-7b22-4045-9b29-403e18495fa0 (7bd935d2-7b22-4045-9b29-403e18495fa0): created successfully
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e10a6be-14cc-4caa-a2e1-177de4933e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Flow 'volume_create_manager' (16441a54-eaa8-4120-9afe-a0d4b73fd164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c6bcfd0e-1502-4cf9-ab14-f4adddf27085 tempest-VolumesTransfersTest-2084043419 None] Created volume successfully.
Sep 24 17:56:07 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD" returned: 0 in 2.662s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-967558350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0617a30a-f345-4b6f-b4bb-b301e505ec16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6c3d982cea423481ddfc2e4ae28d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:01Z,use_quota=True,user_id='b2a64d9b4b6d4f6583af019f0bb537d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Creating volume 0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:07 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:07 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=71, name=volume-0617a30a-f345-4b6f-b4bb-b301e505ec16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 1073741824" returned: 0 in 0.448s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 0.154s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] <== create_volume: return (684ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9d71543c-72f6-435a-98d2-3d34196ab63b tempest-VolumesTransfersTest-1767334546 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:08 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9d71543c-72f6-435a-98d2-3d34196ab63b tempest-VolumesTransfersTest-1767334546 None] Transfer volume completed successfully.
Sep 24 17:56:08 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Attempting download of a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume 0617a30a-f345-4b6f-b4bb-b301e505ec16. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 17:56:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecebbd1-6ef1-4f5c-871d-2549c4a7e7b5]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_mpsz37qm {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_mpsz37qm" returned: 0 in 0.549s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_mpsz37qm {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Acquiring lock "cinder-7bd935d2-7b22-4045-9b29-403e18495fa0-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "cinder-7bd935d2-7b22-4045-9b29-403e18495fa0-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_mpsz37qm" returned: 1 in 0.911s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_mpsz37qm' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8323c034-f495-4317-b374-d6a8a7c4a493]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Acquiring lock "cinder-quobyte-7bd935d2-7b22-4045-9b29-403e18495fa0" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "cinder-quobyte-7bd935d2-7b22-4045-9b29-403e18495fa0" acquired by "delete_volume" :: waited 0.110s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b596c-1995-4d4a-8b55-8ccf9b879071]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] a414f1aa-0123-4732-9dda-73666cba7ecf was qcow2, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 17:56:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:11 devstack quobyte-client[84528]: System call of process 92998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:11 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=71, name=volume-0617a30a-f345-4b6f-b4bb-b301e505ec16, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-ad64740d-e8fd-40c2-a159-0dc64f8df4f5 req-e2532e6e-1d24-49fd-9aeb-41f4993ba5d9 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:11 devstack quobyte-client[84528]: System call of process 92994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0" returned: 0 in 1.080s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-ad64740d-e8fd-40c2-a159-0dc64f8df4f5 req-e2532e6e-1d24-49fd-9aeb-41f4993ba5d9 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-ad64740d-e8fd-40c2-a159-0dc64f8df4f5 req-e2532e6e-1d24-49fd-9aeb-41f4993ba5d9 tempest-AttachVolumeTestJSON-39313904 None] Terminate volume connection completed successfully.
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-ad64740d-e8fd-40c2-a159-0dc64f8df4f5 req-e2532e6e-1d24-49fd-9aeb-41f4993ba5d9 tempest-AttachVolumeTestJSON-39313904 None] Deleting attachment 49f73028-02fb-4c5a-8fd8-93287b36a454. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7bd935d2-7b22-4045-9b29-403e18495fa0" returned: 0 in 0.552s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "cinder-quobyte-7bd935d2-7b22-4045-9b29-403e18495fa0" released by "delete_volume" :: held 1.799s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 1.716s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_h84guwq4devstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:56:12 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Converted 112.00 MB image at 64.97 MB/s
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 1G" returned: 0 in 0.234s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Created reservations ['efdbb8c9-893c-4c0f-9090-549e899b0ddd', '011caabe-cd31-41db-8e85-14049f13bad6', 'fe7cdb1e-eb50-4f58-94c7-902931e95d1b', '66aae0cb-eccc-4041-9f90-2610246de88e'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd30c2b-593e-49c0-a5d8-d5f64bc3ed87]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:13 devstack quobyte-client[84528]: System call of process 93019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:13 devstack quobyte-client[84528]: System call of process 93019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 0.834s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.275s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:56:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Deleted volume successfully.
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-28034aa8-fd85-4559-a121-120b8ba45fcb tempest-VolumesTransfersTest-375741411 None] Lock "cinder-7bd935d2-7b22-4045-9b29-403e18495fa0-delete_volume" released by "delete_volume" :: held 4.662s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:14 devstack quobyte-client[84528]: System call of process 93022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 1 in 0.780s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Downloaded image a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume 0617a30a-f345-4b6f-b4bb-b301e505ec16 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf for user b2a64d9b4b6d4f6583af019f0bb537d9 is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Marking volume 0617a30a-f345-4b6f-b4bb-b301e505ec16 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Copying metadata from image a414f1aa-0123-4732-9dda-73666cba7ecf to 0617a30a-f345-4b6f-b4bb-b301e505ec16. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Creating volume glance metadata for volume 0617a30a-f345-4b6f-b4bb-b301e505ec16 backed by image a414f1aa-0123-4732-9dda-73666cba7ecf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 17:56:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Flow 'volume_create_manager' (152fdbba-b13d-45fb-be21-ab5b77ebf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1c031-4363-41a1-a002-946e73eeace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b1c031-4363-41a1-a002-946e73eeace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-895310624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af8bcc0-1cee-4584-9d3b-b57a23a2573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42b3c827794e569bfe25564bc7fcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:15Z,use_quota=True,user_id='2be60d6e068744bcaf13bd99888aea56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6d422f-23b2-4697-a2d5-c53f8e1cf2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6d422f-23b2-4697-a2d5-c53f8e1cf2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f90614e-8dc3-4d8f-9ea1-5a250bc48c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f90614e-8dc3-4d8f-9ea1-5a250bc48c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af8bcc0-1cee-4584-9d3b-b57a23a2573a', 'volume_name': 'volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba2c9bd-6800-4086-90f0-2b156399830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba2c9bd-6800-4086-90f0-2b156399830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541dc3ed-ca78-40d4-b05e-d0deff845e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:15 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Volume 1af8bcc0-1cee-4584-9d3b-b57a23a2573a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a', 'volume_size': 1}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-895310624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af8bcc0-1cee-4584-9d3b-b57a23a2573a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab42b3c827794e569bfe25564bc7fcef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:15Z,use_quota=True,user_id='2be60d6e068744bcaf13bd99888aea56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Creating volume 1af8bcc0-1cee-4584-9d3b-b57a23a2573a {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.173s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:15 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:15 devstack quobyte-client[84528]: System call of process 93035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:15 devstack quobyte-client[84528]: System call of process 93035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:15 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=72, name=volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7644659a-b878-43a9-9938-92553d9a702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0617a30a-f345-4b6f-b4bb-b301e505ec16', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b864e79a0>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e04d1c-f67b-470b-999d-449f49ff094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a 1073741824" returned: 0 in 2.004s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Volume volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 (0617a30a-f345-4b6f-b4bb-b301e505ec16): created successfully
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e04d1c-f67b-470b-999d-449f49ff094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Flow 'volume_create_manager' (a9816890-787e-4701-94a2-0f4997aa5064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 1.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" returned: 0 in 0.505s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] <== create_volume: return (2701ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.709s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-acd5babd-acba-4252-b05f-6723d48500a5 tempest-VolumesExtendTest-1322167303 None] Created volume successfully.
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541dc3ed-ca78-40d4-b05e-d0deff845e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5de00ab-d106-46d5-af2f-0ef41f4db531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Volume volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a (1af8bcc0-1cee-4584-9d3b-b57a23a2573a): created successfully
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5de00ab-d106-46d5-af2f-0ef41f4db531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Flow 'volume_create_manager' (152fdbba-b13d-45fb-be21-ab5b77ebf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7bf3c1a0-7917-4231-892b-06d61e822acb tempest-VolumesTransfersTest-2084043419 None] Created volume successfully.
Sep 24 17:56:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90458b-9f29-4d38-b09e-a1f46fc4e0dd]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Acquiring lock "cinder-1af8bcc0-1cee-4584-9d3b-b57a23a2573a-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "cinder-1af8bcc0-1cee-4584-9d3b-b57a23a2573a-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 0.651s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Acquiring lock "cinder-quobyte-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "cinder-quobyte-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" acquired by "delete_volume" :: waited 0.095s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[96616dff-5be5-4356-a503-87574dde8b75]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:19 devstack quobyte-client[84528]: System call of process 93106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 1 in 0.719s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 2G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:19 devstack quobyte-client[84528]: System call of process 93110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 2G" returned: 0 in 0.171s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.707s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:20 devstack quobyte-client[84528]: System call of process 93107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:20 devstack quobyte-client[84528]: System call of process 93107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:20 devstack quobyte-client[84528]: System call of process 93107 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" returned: 0 in 0.725s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" returned: 0 in 0.187s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "cinder-quobyte-1af8bcc0-1cee-4584-9d3b-b57a23a2573a" released by "delete_volume" :: held 1.198s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d800fcd5-bf1b-44dd-b6aa-57f94ea86db7 tempest-VolumesExtendTest-1322167303 None] Extend volume completed successfully.
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Created reservations ['1698e13e-2eb3-44c5-8366-36f564f0465f', '68e9eb6b-bbe0-4c9b-98d1-2ba03a52a938', '881d029a-5868-40f3-bfe6-1d8832264c96', '238c230b-0011-4207-80cf-8d22730b415f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:21 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:56:21 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Deleted volume successfully.
Sep 24 17:56:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8942b704-6625-48a6-8caf-a589b7bdfa8b tempest-VolumesTransfersTest-375741411 None] Lock "cinder-1af8bcc0-1cee-4584-9d3b-b57a23a2573a-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-0617a30a-f345-4b6f-b4bb-b301e505ec16-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-0617a30a-f345-4b6f-b4bb-b301e505ec16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-quobyte-0617a30a-f345-4b6f-b4bb-b301e505ec16" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-0617a30a-f345-4b6f-b4bb-b301e505ec16" acquired by "delete_volume" :: waited 0.034s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff12a59-0d81-400c-b2c5-e1d4d1320497]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:22 devstack quobyte-client[84528]: System call of process 93118 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 0.528s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 1 in 0.409s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0617a30a-f345-4b6f-b4bb-b301e505ec16" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-0617a30a-f345-4b6f-b4bb-b301e505ec16" released by "delete_volume" :: held 1.473s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:23 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Created reservations ['2d51e454-cffc-4289-8c72-40e90f68f31c', '6d09c109-9fae-404e-93d6-0146b9325d49', '1975bb81-0216-47f9-9c03-e162095c0424', 'c2c9fa8d-95b6-4e89-90e4-222e2cc1a2b7'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.254s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:56:24 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Deleted volume successfully.
Sep 24 17:56:24 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-23aeb38a-86b5-4825-b0f8-527b6732d110 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-0617a30a-f345-4b6f-b4bb-b301e505ec16-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Flow 'volume_create_manager' (56f91f40-7713-42a0-9ae0-e2dbb0b9637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e111c7b-eaa0-46cf-8b05-d26e99add77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e111c7b-eaa0-46cf-8b05-d26e99add77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1868435174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec6529a-105a-4e3f-a651-5d6274a6dcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6c3d982cea423481ddfc2e4ae28d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:25Z,use_quota=True,user_id='b2a64d9b4b6d4f6583af019f0bb537d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa8a19-8ac0-4035-b986-b0744fa5483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa8a19-8ac0-4035-b986-b0744fa5483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad49c0e-e13a-40ba-bae9-010ededd4ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad49c0e-e13a-40ba-bae9-010ededd4ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec6529a-105a-4e3f-a651-5d6274a6dcc2', 'volume_name': 'volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bcb06c-74ae-4a1f-a60b-fa1131e11539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bcb06c-74ae-4a1f-a60b-fa1131e11539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515d155-48e3-43fc-9f04-7b65896037ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:25 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Volume 6ec6529a-105a-4e3f-a651-5d6274a6dcc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2', 'volume_size': 1}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1868435174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec6529a-105a-4e3f-a651-5d6274a6dcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6c3d982cea423481ddfc2e4ae28d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:25Z,use_quota=True,user_id='b2a64d9b4b6d4f6583af019f0bb537d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Creating volume 6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:25 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:25 devstack quobyte-client[84528]: System call of process 93127 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:25 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=73, name=volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 1073741824" returned: 0 in 0.579s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 0.213s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] <== create_volume: return (928ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4515d155-48e3-43fc-9f04-7b65896037ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519f9f75-ad92-46d6-b40b-61a2b1d8e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=117,cinder:SELECT=74,cinder:INSERT=28,cinder:DELETE=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:56:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Volume volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 (6ec6529a-105a-4e3f-a651-5d6274a6dcc2): created successfully
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519f9f75-ad92-46d6-b40b-61a2b1d8e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Flow 'volume_create_manager' (56f91f40-7713-42a0-9ae0-e2dbb0b9637a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-78bb4a11-7044-49ad-ab9a-5e0203eb951c tempest-VolumesExtendTest-1322167303 None] Created volume successfully.
Sep 24 17:56:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Creating offline snapshot eb4edee9-2656-4aaf-b0ca-7655c8824c9d of volume 6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:56:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a2ae1-9e09-4261-8a1b-317696eccb5c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 0.720s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:28 devstack quobyte-client[84528]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:28 devstack quobyte-client[84528]: System call of process 93143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:28 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=74, name=volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d 1G" returned: 0 in 0.524s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:29 devstack quobyte-client[84528]: System call of process 93148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img rebase -u -b volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 0.306s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 0.303s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:56:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 0.181s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.info" returned: 0 in 0.241s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.info" returned: 0 in 0.188s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-bee82db9-1b81-442f-a247-78244c37d940 tempest-VolumesExtendTest-1322167303 None] Create snapshot completed successfully
Sep 24 17:56:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:32 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaad752-0289-4a57-8777-3630c11d9bea]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:32 devstack quobyte-client[84528]: System call of process 93166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:32 devstack quobyte-client[84528]: System call of process 93166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:32 devstack quobyte-client[84528]: System call of process 93166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 0.701s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d 2G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:33 devstack quobyte-client[84528]: System call of process 93173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:33 devstack quobyte-client[84528]: System call of process 93173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d 2G" returned: 0 in 0.595s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.502s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e1c0e912-32df-4d60-bd0e-1c2bdfb9a20e tempest-VolumesExtendTest-1322167303 None] Extend volume completed successfully.
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-eb4edee9-2656-4aaf-b0ca-7655c8824c9d-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-eb4edee9-2656-4aaf-b0ca-7655c8824c9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.289s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-quobyte-eb4edee9-2656-4aaf-b0ca-7655c8824c9d" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-eb4edee9-2656-4aaf-b0ca-7655c8824c9d" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Deleting offline snapshot eb4edee9-2656-4aaf-b0ca-7655c8824c9d of volume 6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] snapshot_file for this snap is: volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9997a9b-479d-4ba6-adda-26844d015eab]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:37 devstack quobyte-client[84528]: System call of process 93213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 1.413s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:56:37 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf42490-6400-4766-9b8d-c9637ff59295]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:38 devstack quobyte-client[84528]: System call of process 93230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 1.474s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:39 devstack quobyte-client[84528]: System call of process 93237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:39 devstack quobyte-client[84528]: System call of process 93237 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:39 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Flow 'volume_create_manager' (979b2936-f420-4a34-95d6-31d62051b5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ca634c-809b-4695-9e98-844d4d64a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ca634c-809b-4695-9e98-844d4d64a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1994139845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6936a2cd-2382-4f9f-b9cf-7b539862fa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ccac018c7c448d810c992b22c1c1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:38Z,use_quota=True,user_id='724ab594e00247c69205c8ef1c5c2847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21ca4c8-10f3-4de1-afab-68226a476b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21ca4c8-10f3-4de1-afab-68226a476b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b836a247-0a4f-4054-accc-9d06b1d6d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b836a247-0a4f-4054-accc-9d06b1d6d269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6936a2cd-2382-4f9f-b9cf-7b539862fa48', 'volume_name': 'volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82504c8b-2950-428d-97f4-7f1e39d23d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82504c8b-2950-428d-97f4-7f1e39d23d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f908c18e-d54c-4dc9-8c9a-62d8172df2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:40 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48', 'volume_size': 1}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1994139845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6936a2cd-2382-4f9f-b9cf-7b539862fa48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ccac018c7c448d810c992b22c1c1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:38Z,use_quota=True,user_id='724ab594e00247c69205c8ef1c5c2847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Creating volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:40 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:40 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=76, name=volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 1.631s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 1073741824" returned: 0 in 0.638s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2.eb4edee9-2656-4aaf-b0ca-7655c8824c9d" returned: 0 in 0.458s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48" returned: 0 in 0.307s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] <== create_volume: return (993ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-eb4edee9-2656-4aaf-b0ca-7655c8824c9d" released by "_delete_snapshot" :: held 5.801s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" released by "delete_snapshot" :: held 5.855s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f908c18e-d54c-4dc9-8c9a-62d8172df2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50508267-a87f-4f0f-8b77-4f932178f47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:41 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 (6936a2cd-2382-4f9f-b9cf-7b539862fa48): created successfully
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50508267-a87f-4f0f-8b77-4f932178f47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Flow 'volume_create_manager' (979b2936-f420-4a34-95d6-31d62051b5a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Created reservations ['7225a3e1-61b2-4fb5-a60e-3d39746d4be3', '71e27475-8d31-4c5c-b02d-5a7d031b41fa', '5a2010a8-7d87-4dba-ae8b-61524fb06d68', '38700ce0-3ba5-408e-8922-678297b5c394'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e3c7f84b-ea43-408a-afaa-d7540a15058d tempest-VolumesSnapshotListTestJSON-1214826362 None] Created volume successfully.
Sep 24 17:56:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Delete snapshot completed successfully.
Sep 24 17:56:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-54f372b9-bf35-446c-b9c6-28170e410f74 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-eb4edee9-2656-4aaf-b0ca-7655c8824c9d-delete_snapshot" released by "delete_snapshot" :: held 6.241s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-6ec6529a-105a-4e3f-a651-5d6274a6dcc2-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-6ec6529a-105a-4e3f-a651-5d6274a6dcc2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[588452a2-593a-4581-b5b7-e0400a3db8b6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:42 devstack quobyte-client[84528]: System call of process 93257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:42 devstack quobyte-client[84528]: System call of process 93257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:42 devstack quobyte-client[84528]: System call of process 93257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:42 devstack quobyte-client[84528]: System call of process 93257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:42 devstack quobyte-client[84528]: System call of process 93257 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 0.559s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" returned: 0 in 0.382s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-quobyte-6ec6529a-105a-4e3f-a651-5d6274a6dcc2" released by "delete_volume" :: held 1.191s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Creating offline snapshot 16a19983-1754-45c7-943e-640e3f45be99 of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972f61b-730e-4b16-9eab-b4c22a5e059a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Created reservations ['342379f4-4c50-47a4-8660-d1a8ea51f49c', '1205236d-0216-4a4d-b38f-51e4aa55aa51', '514803db-775b-4d4b-bbf3-51a85efc8250', '5af08dd6-14fe-449b-80b6-9aba6c0fc74c'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48" returned: 0 in 0.623s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:44 devstack quobyte-client[84528]: System call of process 93264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:44 devstack quobyte-client[84528]: System call of process 93264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:44 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=77, name=volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 1G" returned: 0 in 0.573s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.216s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.185s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.357s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.382s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:56:45 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Deleted volume successfully.
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.info" returned: 0 in 0.449s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b81159ac-7af5-4902-ad53-42dd064247b2 tempest-VolumesExtendTest-1322167303 None] Lock "cinder-6ec6529a-105a-4e3f-a651-5d6274a6dcc2-delete_volume" released by "delete_volume" :: held 4.194s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.info" returned: 0 in 0.343s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.071s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6f4093df-a45c-4b8a-ae06-8184af9a30f1 tempest-VolumesSnapshotListTestJSON-1214826362 None] Create snapshot completed successfully
Sep 24 17:56:47 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Creating offline snapshot 9923e83e-efa3-4c38-8429-5750ebccd01d of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:56:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71caaf-96fa-46a2-a92f-628f03222349]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93276 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.472s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93279 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=79, name=volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d 1G" returned: 0 in 0.359s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack quobyte-client[84528]: System call of process 93282 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.235s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.108s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:56:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.131s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-707cf11d-b535-4960-a416-20dff593091f tempest-VolumesSnapshotListTestJSON-1214826362 None] Create snapshot completed successfully
Sep 24 17:56:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Flow 'volume_create_manager' (7cb4bbf3-df7c-4ea5-91a7-496b40187910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b008fbb8-c318-4cc9-852a-83a9213ae581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b008fbb8-c318-4cc9-852a-83a9213ae581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-556729514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccceca0d-9937-48a7-87d6-bd39f58e6f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3afcb6f664f401f81e8b60d336f1e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:49Z,use_quota=True,user_id='919cf4060a27447f95347fd0d99fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67249afd-8c0d-460e-b8d8-8daf7657879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67249afd-8c0d-460e-b8d8-8daf7657879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fde624-1265-464b-8be8-8d9a61d21574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fde624-1265-464b-8be8-8d9a61d21574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccceca0d-9937-48a7-87d6-bd39f58e6f09', 'volume_name': 'volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c173298e-b6c4-457c-91cb-510081227d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c173298e-b6c4-457c-91cb-510081227d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af5b45f-4fec-44b9-ab67-39460926d6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:49 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Volume ccceca0d-9937-48a7-87d6-bd39f58e6f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09', 'volume_size': 1}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-556729514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccceca0d-9937-48a7-87d6-bd39f58e6f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3afcb6f664f401f81e8b60d336f1e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:56:49Z,use_quota=True,user_id='919cf4060a27447f95347fd0d99fd3d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Creating volume ccceca0d-9937-48a7-87d6-bd39f58e6f09 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:56:49 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:56:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:49 devstack quobyte-client[84528]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:49 devstack quobyte-client[84528]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:49 devstack quobyte-client[84528]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:49 devstack quobyte-client[84528]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:49 devstack quobyte-client[84528]: System call of process 93287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:49 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=80, name=volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 1073741824" returned: 0 in 0.379s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09" returned: 0 in 0.119s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.586s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af5b45f-4fec-44b9-ab67-39460926d6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78d62e3-d147-4d84-8468-91c73c99f4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:56:50 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Volume volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 (ccceca0d-9937-48a7-87d6-bd39f58e6f09): created successfully
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78d62e3-d147-4d84-8468-91c73c99f4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Flow 'volume_create_manager' (7cb4bbf3-df7c-4ea5-91a7-496b40187910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:56:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2b94eb05-2127-4082-b8c0-47cac01293d1 tempest-VolumesNegativeTest-217794608 None] Created volume successfully.
Sep 24 17:56:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:56:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Creating offline snapshot 318a96b6-4a94-468e-bbda-2fad56dc92bd of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:56:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dc3f5a-81d8-426b-bb29-f604543b41fc]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.414s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:56:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:51 devstack quobyte-client[84528]: System call of process 93295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:51 devstack quobyte-client[84528]: System call of process 93295 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:51 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=81, name=volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd 1G" returned: 0 in 0.482s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:52 devstack quobyte-client[84528]: System call of process 93298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:52 devstack quobyte-client[84528]: System call of process 93298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:52 devstack quobyte-client[84528]: System call of process 93298 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img rebase -u -b volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.294s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.145s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.147s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:56:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-00d31507-b73f-4930-b9c2-e832ae8738ba tempest-VolumesSnapshotListTestJSON-1214826362 None] Create snapshot completed successfully
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-318a96b6-4a94-468e-bbda-2fad56dc92bd-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-318a96b6-4a94-468e-bbda-2fad56dc92bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-318a96b6-4a94-468e-bbda-2fad56dc92bd" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-318a96b6-4a94-468e-bbda-2fad56dc92bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Deleting offline snapshot 318a96b6-4a94-468e-bbda-2fad56dc92bd of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] snapshot_file for this snap is: volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce473ae-2204-4123-a58d-00a86e9c45d6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:56 devstack quobyte-client[84528]: System call of process 93309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.495s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f0d29d-a01c-45b2-bad0-dec907fedf05]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:57 devstack quobyte-client[84528]: System call of process 93312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.484s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:56:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:57 devstack quobyte-client[84528]: System call of process 93315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:57 devstack quobyte-client[84528]: System call of process 93315 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:56:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.363s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.318a96b6-4a94-468e-bbda-2fad56dc92bd" returned: 0 in 0.127s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-318a96b6-4a94-468e-bbda-2fad56dc92bd" released by "_delete_snapshot" :: held 1.997s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" released by "delete_snapshot" :: held 2.031s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=63,cinder:INSERT=17,cinder:UPDATE=73,cinder:DELETE=9 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Created reservations ['04d845b0-1d4e-4327-b6e8-90f68b19de08', '826e58c4-b1d5-4be5-8c85-ebf083efdc5f', '5bbafc70-a0a9-4f79-992d-ae76d7d08ce5', '48e21b12-baa7-45bb-88d3-3225675723fa'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:56:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Delete snapshot completed successfully.
Sep 24 17:56:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6bd403e3-d69e-4a32-80d7-99ec3a663a85 tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-318a96b6-4a94-468e-bbda-2fad56dc92bd-delete_snapshot" released by "delete_snapshot" :: held 2.525s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-9923e83e-efa3-4c38-8429-5750ebccd01d-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-9923e83e-efa3-4c38-8429-5750ebccd01d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" acquired by "delete_snapshot" :: waited 0.075s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-9923e83e-efa3-4c38-8429-5750ebccd01d" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-9923e83e-efa3-4c38-8429-5750ebccd01d" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Deleting offline snapshot 9923e83e-efa3-4c38-8429-5750ebccd01d of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] snapshot_file for this snap is: volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[700df8e6-079a-4a51-8497-52ecd22f8982]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:56:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:00 devstack quobyte-client[84528]: System call of process 93319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:00 devstack quobyte-client[84528]: System call of process 93319 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.937s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:57:01 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[158daeaf-c4c9-44e5-82ed-002857b84721]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:02 devstack quobyte-client[84528]: System call of process 93323 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 1.156s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:57:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:02 devstack quobyte-client[84528]: System call of process 93330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:02 devstack quobyte-client[84528]: System call of process 93330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:02 devstack quobyte-client[84528]: System call of process 93330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.612s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.9923e83e-efa3-4c38-8429-5750ebccd01d" returned: 0 in 0.179s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-9923e83e-efa3-4c38-8429-5750ebccd01d" released by "_delete_snapshot" :: held 3.873s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" released by "delete_snapshot" :: held 3.946s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:04 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Created reservations ['3a3f50c6-df1f-4b27-bab7-1b70641b424a', '8455f534-af9f-4579-9ba8-1b34d09cee8e', '7e676ea6-e752-4e5c-bdec-fb1f065d5294', '8fbfa41f-b762-4526-9588-7b45e9683d5b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:04 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Delete snapshot completed successfully.
Sep 24 17:57:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9beb0f66-d894-4c1a-8917-46a7751a2d9c tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-9923e83e-efa3-4c38-8429-5750ebccd01d-delete_snapshot" released by "delete_snapshot" :: held 5.363s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-16a19983-1754-45c7-943e-640e3f45be99-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-16a19983-1754-45c7-943e-640e3f45be99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:05 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" acquired by "delete_snapshot" :: waited 0.061s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-16a19983-1754-45c7-943e-640e3f45be99" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-16a19983-1754-45c7-943e-640e3f45be99" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Deleting offline snapshot 16a19983-1754-45c7-943e-640e3f45be99 of volume 6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] snapshot_file for this snap is: volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54c8ae7-a564-4e6d-8395-92967bc73a7d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:06 devstack quobyte-client[84528]: System call of process 93346 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.787s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:57:06 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac18796-0ad9-47a4-9cb5-ac499fb0d3b2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:07 devstack quobyte-client[84528]: System call of process 93350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48" returned: 0 in 0.490s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:07 devstack quobyte-client[84528]: System call of process 93353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:07 devstack quobyte-client[84528]: System call of process 93353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.295s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48.16a19983-1754-45c7-943e-640e3f45be99" returned: 0 in 0.156s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-16a19983-1754-45c7-943e-640e3f45be99" released by "_delete_snapshot" :: held 2.464s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" released by "delete_snapshot" :: held 2.517s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:09 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Created reservations ['7a1d1fd1-c60f-4e91-8d21-d44bc0332b07', '325426db-f714-43b5-9182-8e2cc5de1887', '74a09cc7-8241-4b85-b881-055a48be6248', '09a87f26-516c-4ad3-9ec3-11c5fdda5590'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Delete snapshot completed successfully.
Sep 24 17:57:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-89597321-1c36-4f04-88af-4d672d8ef01d tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-16a19983-1754-45c7-943e-640e3f45be99-delete_snapshot" released by "delete_snapshot" :: held 3.534s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-6936a2cd-2382-4f9f-b9cf-7b539862fa48-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-6936a2cd-2382-4f9f-b9cf-7b539862fa48-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088bad8-52c4-42a5-b86f-f85a0626f6b3]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:11 devstack quobyte-client[84528]: System call of process 93365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48" returned: 0 in 0.915s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6936a2cd-2382-4f9f-b9cf-7b539862fa48" returned: 0 in 0.116s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-quobyte-6936a2cd-2382-4f9f-b9cf-7b539862fa48" released by "delete_volume" :: held 1.254s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:11 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Created reservations ['193338b1-fc57-42f1-815f-51ba86c9089d', 'b764f5bb-e6b8-4fba-92a9-c7fffd20840b', '5cb9eb90-dc20-407e-a681-291abcce8985', 'e38e63ca-15a9-4e91-a15e-68c377b471ac'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.164s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Deleted volume successfully.
Sep 24 17:57:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2ff2a1cd-a519-4214-a207-05591c817b4a tempest-VolumesSnapshotListTestJSON-1214826362 None] Lock "cinder-6936a2cd-2382-4f9f-b9cf-7b539862fa48-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.552s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:22 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:INSERT=9,cinder:UPDATE=24,cinder:SELECT=16 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:57:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:22 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (1af98d14-7723-4b35-be7b-adb47fbe1e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5872d2-52da-4f72-aac0-1205de298203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5872d2-52da-4f72-aac0-1205de298203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050010813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6ee4b7-a23e-4aee-95e7-d148664e32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:22Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a873d629-0bbc-460d-8ab6-b884a7752819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a873d629-0bbc-460d-8ab6-b884a7752819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f987e216-1f98-4049-a5e4-22e30a7897ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f987e216-1f98-4049-a5e4-22e30a7897ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6ee4b7-a23e-4aee-95e7-d148664e32a9', 'volume_name': 'volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee632dd1-7702-4e64-8fbd-435dcd8993ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee632dd1-7702-4e64-8fbd-435dcd8993ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05a1ec5-6ada-4981-9f5a-fb3a9b7d8c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:23 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Volume ee6ee4b7-a23e-4aee-95e7-d148664e32a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9', 'volume_size': 1}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1050010813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6ee4b7-a23e-4aee-95e7-d148664e32a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:22Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Creating volume ee6ee4b7-a23e-4aee-95e7-d148664e32a9 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:23 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:23 devstack quobyte-client[84528]: System call of process 93490 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:23 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=82, name=volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:24 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (73d907d4-069c-482f-904f-d6f8e7ce3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee1271-93bd-4365-acc3-d3ef7d2286be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dee1271-93bd-4365-acc3-d3ef7d2286be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345328805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31575313-bee5-453d-bb35-d76cd9d1db3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:23Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f9503a-8333-4854-b5ab-53f346a0e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f9503a-8333-4854-b5ab-53f346a0e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56f74a-5386-4cbc-aa6b-c91d3fa4cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56f74a-5386-4cbc-aa6b-c91d3fa4cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31575313-bee5-453d-bb35-d76cd9d1db3c', 'volume_name': 'volume-31575313-bee5-453d-bb35-d76cd9d1db3c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2167a1-7e5e-425f-893e-ced74645f629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2167a1-7e5e-425f-893e-ced74645f629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a8f183-b8f9-4985-83f2-3e8256219631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Volume 31575313-bee5-453d-bb35-d76cd9d1db3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31575313-bee5-453d-bb35-d76cd9d1db3c', 'volume_size': 1}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 1073741824" returned: 0 in 2.078s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (51eb8fdd-00c8-4695-9df7-aae8034d9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5587fa9f-c076-4923-baba-a974262b1a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (0b36f853-7ecf-4f50-9111-130d33914b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f7b98f-b985-4314-91e0-d838126bd991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (b01c8f07-2f62-475d-8f23-cbe2561cfe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efe8f6d-42fb-440d-a7e4-7d18f7ed8fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5587fa9f-c076-4923-baba-a974262b1a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936101275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988aa1f6-97e4-4f0b-8adf-a90d810ff237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:25Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95fd8fb-59fa-430b-89f5-904b1f2067c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95fd8fb-59fa-430b-89f5-904b1f2067c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6241acde-666c-484a-83de-0c8dd7a8d28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6241acde-666c-484a-83de-0c8dd7a8d28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988aa1f6-97e4-4f0b-8adf-a90d810ff237', 'volume_name': 'volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839dfaf1-7981-48dc-8fac-11b574fb29c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839dfaf1-7981-48dc-8fac-11b574fb29c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650d328a-8efb-4546-8518-77d71f04643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Volume 988aa1f6-97e4-4f0b-8adf-a90d810ff237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237', 'volume_size': 1}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" returned: 0 in 0.592s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] <== create_volume: return (2768ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.780s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f7b98f-b985-4314-91e0-d838126bd991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918109931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0135c9-4087-4bcb-b4d0-3839d6673c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:24Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad30b9d-9ba0-4a46-a547-365e97a360f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad30b9d-9ba0-4a46-a547-365e97a360f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e6ad1-c5d0-4a0c-a712-d87d8d6373f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36e6ad1-c5d0-4a0c-a712-d87d8d6373f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0135c9-4087-4bcb-b4d0-3839d6673c18', 'volume_name': 'volume-da0135c9-4087-4bcb-b4d0-3839d6673c18', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d882235-6e31-4fb6-bd71-2cae840b5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d882235-6e31-4fb6-bd71-2cae840b5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698d1ca7-c021-49bc-9ba7-fec2ca649ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Volume da0135c9-4087-4bcb-b4d0-3839d6673c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0135c9-4087-4bcb-b4d0-3839d6673c18', 'volume_size': 1}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-918109931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0135c9-4087-4bcb-b4d0-3839d6673c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:24Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Creating volume da0135c9-4087-4bcb-b4d0-3839d6673c18 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:26 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:26 devstack quobyte-client[84528]: System call of process 93496 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:26 devstack quobyte-client[84528]: System call of process 93496 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:26 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=83, name=volume-da0135c9-4087-4bcb-b4d0-3839d6673c18, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efe8f6d-42fb-440d-a7e4-7d18f7ed8fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487778895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623b367f-0963-465e-a103-d8517716c39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:25Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8e2434-a355-43e7-a074-dcfa0e3261d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8e2434-a355-43e7-a074-dcfa0e3261d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d7811b-2e1a-4d9f-aa8a-11453291ef46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d7811b-2e1a-4d9f-aa8a-11453291ef46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623b367f-0963-465e-a103-d8517716c39e', 'volume_name': 'volume-623b367f-0963-465e-a103-d8517716c39e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c648da6-3abd-4983-b5cd-cdc07bbc72d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c648da6-3abd-4983-b5cd-cdc07bbc72d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd2fb2-fe05-441d-9169-46a02e15f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Volume 623b367f-0963-465e-a103-d8517716c39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623b367f-0963-465e-a103-d8517716c39e', 'volume_size': 1}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05a1ec5-6ada-4981-9f5a-fb3a9b7d8c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a57a92-c8df-444f-9e8e-6f72bc0a67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 1073741824" returned: 0 in 0.760s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Volume volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 (ee6ee4b7-a23e-4aee-95e7-d148664e32a9): created successfully
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a57a92-c8df-444f-9e8e-6f72bc0a67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (1af98d14-7723-4b35-be7b-adb47fbe1e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18" returned: 0 in 0.388s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] <== create_volume: return (1189ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936101275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988aa1f6-97e4-4f0b-8adf-a90d810ff237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:25Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Creating volume 988aa1f6-97e4-4f0b-8adf-a90d810ff237 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:27 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:DELETE=4,cinder:SELECT=45,cinder:UPDATE=50,cinder:INSERT=11 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:57:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2ec7cca9-1e78-4008-af2a-6faed50a5416 tempest-CreateVolumesFromImageTest-1438541981 None] Created volume successfully.
Sep 24 17:57:27 devstack quobyte-client[84528]: System call of process 93500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:27 devstack quobyte-client[84528]: System call of process 93500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:27 devstack quobyte-client[84528]: System call of process 93500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:27 devstack quobyte-client[84528]: System call of process 93500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:27 devstack quobyte-client[84528]: System call of process 93500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:27 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=84, name=volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698d1ca7-c021-49bc-9ba7-fec2ca649ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0135c9-4087-4bcb-b4d0-3839d6673c18', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd9266-a931-42cf-9fdb-4ce2d3db3d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:28 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Volume volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 (da0135c9-4087-4bcb-b4d0-3839d6673c18): created successfully
Sep 24 17:57:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd9266-a931-42cf-9fdb-4ce2d3db3d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (0b36f853-7ecf-4f50-9111-130d33914b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 1073741824" returned: 0 in 0.818s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f1106d8c-a370-465f-8168-50d725297374 tempest-CreateVolumesFromImageTest-1438541981 None] Created volume successfully.
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237" returned: 0 in 1.182s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] <== create_volume: return (2048ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.066s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.115s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-345328805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31575313-bee5-453d-bb35-d76cd9d1db3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:23Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Creating volume 31575313-bee5-453d-bb35-d76cd9d1db3c {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:29 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:29 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=85, name=volume-31575313-bee5-453d-bb35-d76cd9d1db3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650d328a-8efb-4546-8518-77d71f04643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a1c90-2a1a-44aa-b2e7-6f086054032f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:30 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Volume volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 (988aa1f6-97e4-4f0b-8adf-a90d810ff237): created successfully
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718a1c90-2a1a-44aa-b2e7-6f086054032f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (51eb8fdd-00c8-4695-9df7-aae8034d9d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c 1073741824" returned: 0 in 0.960s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c" returned: 0 in 0.272s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] <== create_volume: return (1319ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487778895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623b367f-0963-465e-a103-d8517716c39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d2c554efab4ae2bdd61aa23dc822b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:25Z,use_quota=True,user_id='c5cb74affe3843e8af8b9116f0296499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Creating volume 623b367f-0963-465e-a103-d8517716c39e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:31 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2764508c-15e8-4d96-b584-9fe57e29cc35 tempest-CreateVolumesFromImageTest-1438541981 None] Created volume successfully.
Sep 24 17:57:31 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=86, name=volume-623b367f-0963-465e-a103-d8517716c39e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a8f183-b8f9-4985-83f2-3e8256219631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31575313-bee5-453d-bb35-d76cd9d1db3c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a408d-1c66-42d7-8213-43c12ccf67ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e 1073741824" returned: 0 in 1.277s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:32 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Volume volume-31575313-bee5-453d-bb35-d76cd9d1db3c (31575313-bee5-453d-bb35-d76cd9d1db3c): created successfully
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155a408d-1c66-42d7-8213-43c12ccf67ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (73d907d4-069c-482f-904f-d6f8e7ce3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e" returned: 0 in 0.441s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] <== create_volume: return (1757ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d5ce5431-c04c-40db-869b-a4b2febe638b tempest-CreateVolumesFromImageTest-1438541981 None] Created volume successfully.
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dd2fb2-fe05-441d-9169-46a02e15f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623b367f-0963-465e-a103-d8517716c39e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9616311-3988-4750-8bad-01ac43c68482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:32 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Volume volume-623b367f-0963-465e-a103-d8517716c39e (623b367f-0963-465e-a103-d8517716c39e): created successfully
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9616311-3988-4750-8bad-01ac43c68482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Flow 'volume_create_manager' (b01c8f07-2f62-475d-8f23-cbe2561cfe43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9a74cf49-35bf-4ba3-a75c-5958c5a6ff5a tempest-CreateVolumesFromImageTest-1438541981 None] Created volume successfully.
Sep 24 17:57:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-623b367f-0963-465e-a103-d8517716c39e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-623b367f-0963-465e-a103-d8517716c39e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-quobyte-623b367f-0963-465e-a103-d8517716c39e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-623b367f-0963-465e-a103-d8517716c39e" acquired by "delete_volume" :: waited 0.083s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4839ee-8d9d-4713-9ce0-33417645b8fa]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e" returned: 0 in 0.782s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-623b367f-0963-465e-a103-d8517716c39e" returned: 0 in 0.103s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-623b367f-0963-465e-a103-d8517716c39e" released by "delete_volume" :: held 1.141s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Created reservations ['2351161c-70a3-4a43-a335-7816d477c6e3', '99d45c43-5ebd-4773-a670-7343dd17209e', '8f7c2bca-6456-46ab-9b35-a16e633bf484', 'b2ae9665-8889-47dc-93c4-db9c0946458e'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.228s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-988aa1f6-97e4-4f0b-8adf-a90d810ff237-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Deleted volume successfully.
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-988aa1f6-97e4-4f0b-8adf-a90d810ff237-delete_volume" acquired by "delete_volume" :: waited 0.194s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f4bfac1-bb4d-4bbf-bbaf-c13df502a5c2 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-623b367f-0963-465e-a103-d8517716c39e-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-quobyte-988aa1f6-97e4-4f0b-8adf-a90d810ff237" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-988aa1f6-97e4-4f0b-8adf-a90d810ff237" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[037e6c2d-ffcc-4f2a-87d7-d299f2191f99]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237" returned: 0 in 0.541s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-988aa1f6-97e4-4f0b-8adf-a90d810ff237" returned: 0 in 0.168s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-988aa1f6-97e4-4f0b-8adf-a90d810ff237" released by "delete_volume" :: held 0.920s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Created reservations ['136d6119-cdcf-4d94-8915-4e85eb774142', 'b5547338-ff84-4d66-8213-240977821a8d', 'd1112fb6-32a5-467a-85a2-63ddc771e489', '7c7b3c61-c22f-4862-874a-bf8d5915d666'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.164s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Deleted volume successfully.
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-da0135c9-4087-4bcb-b4d0-3839d6673c18-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-da0135c9-4087-4bcb-b4d0-3839d6673c18-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7a6997da-33cc-491b-9395-4b6147afc8e9 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-988aa1f6-97e4-4f0b-8adf-a90d810ff237-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-quobyte-da0135c9-4087-4bcb-b4d0-3839d6673c18" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-da0135c9-4087-4bcb-b4d0-3839d6673c18" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1112cf-209d-4f49-8e4e-032b507d6784]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:39 devstack quobyte-client[84528]: System call of process 93611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18" returned: 0 in 0.646s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da0135c9-4087-4bcb-b4d0-3839d6673c18" returned: 0 in 0.142s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-da0135c9-4087-4bcb-b4d0-3839d6673c18" released by "delete_volume" :: held 0.999s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Created reservations ['abe824d3-04f9-4411-ad92-4ae13b4c812a', '46cc8ed1-8e8a-452c-949e-d4a0fa41bd59', '24989144-76a0-4573-82be-7b9f9044ed23', '8766386b-a408-4e8e-a5b6-f2922439939d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.148s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Deleted volume successfully.
Sep 24 17:57:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-460b32d7-cac7-4929-aa8b-e214f23e1181 tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-da0135c9-4087-4bcb-b4d0-3839d6673c18-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-31575313-bee5-453d-bb35-d76cd9d1db3c-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-31575313-bee5-453d-bb35-d76cd9d1db3c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:41 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-quobyte-31575313-bee5-453d-bb35-d76cd9d1db3c" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-31575313-bee5-453d-bb35-d76cd9d1db3c" acquired by "delete_volume" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9fd085-2c8b-4765-90bc-616261696a3b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:42 devstack quobyte-client[84528]: System call of process 93623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c" returned: 0 in 0.685s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-31575313-bee5-453d-bb35-d76cd9d1db3c" returned: 0 in 0.204s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-31575313-bee5-453d-bb35-d76cd9d1db3c" released by "delete_volume" :: held 1.167s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Created reservations ['cf94cb32-8648-4e48-b031-04c5c2565fc5', '810382a1-5ac2-402e-9154-3fd482588c54', 'a85f4d64-072d-4fe5-bc79-fb40ebf95894', '9bd59acd-d8d2-430b-82ff-571e43e869d3'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.127s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Deleted volume successfully.
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-2a7a1dc1-4d91-4b9a-aab2-1f436b90711c tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-31575313-bee5-453d-bb35-d76cd9d1db3c-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-ee6ee4b7-a23e-4aee-95e7-d148664e32a9-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-ee6ee4b7-a23e-4aee-95e7-d148664e32a9-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "cinder-quobyte-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4c27a-70f5-43db-b4bf-6a5ba6455662]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:45 devstack quobyte-client[84528]: System call of process 93629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:45 devstack quobyte-client[84528]: System call of process 93629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" returned: 0 in 1.163s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" returned: 0 in 0.271s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-quobyte-ee6ee4b7-a23e-4aee-95e7-d148664e32a9" released by "delete_volume" :: held 1.868s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Acquiring lock "cinder-ccceca0d-9937-48a7-87d6-bd39f58e6f09-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Created reservations ['4571f864-3f9b-4044-8c81-c4cf59a12b65', 'ae1ac694-619d-4057-a1b3-e8796758d932', '09e77876-1f26-4a1d-a724-b3a7b0c355de', '749cdff5-bbb4-4ac2-9f7f-57f98c4f5a26'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "cinder-ccceca0d-9937-48a7-87d6-bd39f58e6f09-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Acquiring lock "cinder-quobyte-ccceca0d-9937-48a7-87d6-bd39f58e6f09" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.190s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:47 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "cinder-quobyte-ccceca0d-9937-48a7-87d6-bd39f58e6f09" acquired by "delete_volume" :: waited 0.297s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:57:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Deleted volume successfully.
Sep 24 17:57:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c4a46a-35bc-4318-8111-30f04e85247e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:57:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-77d19548-b360-4396-8818-1126f794630f tempest-CreateVolumesFromImageTest-1438541981 None] Lock "cinder-ee6ee4b7-a23e-4aee-95e7-d148664e32a9-delete_volume" released by "delete_volume" :: held 3.840s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:47 devstack quobyte-client[84528]: System call of process 93636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:47 devstack quobyte-client[84528]: System call of process 93636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:47 devstack quobyte-client[84528]: System call of process 93636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09" returned: 0 in 0.743s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ccceca0d-9937-48a7-87d6-bd39f58e6f09" returned: 0 in 0.299s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "cinder-quobyte-ccceca0d-9937-48a7-87d6-bd39f58e6f09" released by "delete_volume" :: held 1.465s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:48 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Created reservations ['f5ba61b9-e848-4ae8-9e95-f8e8c90664f6', '15eb1cca-c4a5-4066-9b7e-a8998ed79559', '86e8d2c9-95a4-4358-89f4-13132a65f8b4', '1f113bf8-7a12-40b5-abe7-499537bf35df'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.262s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:49 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:57:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Deleted volume successfully.
Sep 24 17:57:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-86502b89-71fd-4fe4-8d45-0bcb03267c0f tempest-VolumesNegativeTest-217794608 None] Lock "cinder-ccceca0d-9937-48a7-87d6-bd39f58e6f09-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:57:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:52 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (f573bac7-7a75-415e-9aed-d1eac044ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d690d145-90d1-483e-8953-bb9b23baf8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d690d145-90d1-483e-8953-bb9b23baf8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132870357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21bfd71-6868-40f2-8aa8-837419e15099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:53Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553bb93d-5a44-4f79-913c-6d7dee217950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (553bb93d-5a44-4f79-913c-6d7dee217950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdaa17a-1e14-43c7-a4d7-ec13f8d97a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdaa17a-1e14-43c7-a4d7-ec13f8d97a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21bfd71-6868-40f2-8aa8-837419e15099', 'volume_name': 'volume-b21bfd71-6868-40f2-8aa8-837419e15099', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94386f99-1862-44d4-8037-ed0018c7360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94386f99-1862-44d4-8037-ed0018c7360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b62ff0e-b6a6-4b37-a7d4-50b488ddd418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume b21bfd71-6868-40f2-8aa8-837419e15099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21bfd71-6868-40f2-8aa8-837419e15099', 'volume_size': 1}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132870357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21bfd71-6868-40f2-8aa8-837419e15099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:53Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume b21bfd71-6868-40f2-8aa8-837419e15099 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:53 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:53 devstack quobyte-client[84528]: System call of process 93683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:53 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=87, name=volume-b21bfd71-6868-40f2-8aa8-837419e15099, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099 1073741824" returned: 0 in 0.558s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099" returned: 0 in 0.274s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (1084ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:54 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b62ff0e-b6a6-4b37-a7d4-50b488ddd418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21bfd71-6868-40f2-8aa8-837419e15099', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25683651-46fd-44d8-bc20-1c1a6cb0596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-b21bfd71-6868-40f2-8aa8-837419e15099 (b21bfd71-6868-40f2-8aa8-837419e15099): created successfully
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25683651-46fd-44d8-bc20-1c1a6cb0596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (f573bac7-7a75-415e-9aed-d1eac044ad01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:55 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-600d25e8-588d-440f-9de1-4900d0cb7428 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:57:55 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Flow 'volume_create_manager' (78413ff3-07d6-40ac-ac3b-84b2e079b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae142eeb-6ca5-4ad8-98b1-1e1adfbec45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae142eeb-6ca5-4ad8-98b1-1e1adfbec45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1208246162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd003c-d041-44aa-897a-a09957500801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2155f70a930743d683c0a3e42361ff88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:56Z,use_quota=True,user_id='4189ab190b8146cb9cb447bfdb79c789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91816eaa-85dc-4b4b-ad2d-54ec93acfcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91816eaa-85dc-4b4b-ad2d-54ec93acfcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de6eee-ffb8-49a7-b36b-95093c5401a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7de6eee-ffb8-49a7-b36b-95093c5401a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fd003c-d041-44aa-897a-a09957500801', 'volume_name': 'volume-b0fd003c-d041-44aa-897a-a09957500801', 'volume_size': 2}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8522ed3-b636-4cb1-8959-76bbb7075289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8522ed3-b636-4cb1-8959-76bbb7075289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54110758-eadc-4c5c-b777-42aed983d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:55 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume b0fd003c-d041-44aa-897a-a09957500801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fd003c-d041-44aa-897a-a09957500801', 'volume_size': 2}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1208246162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fd003c-d041-44aa-897a-a09957500801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2155f70a930743d683c0a3e42361ff88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:56Z,use_quota=True,user_id='4189ab190b8146cb9cb447bfdb79c789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Creating volume b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:55 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 2147483648 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:56 devstack quobyte-client[84528]: System call of process 93689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:56 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=88, name=volume-b0fd003c-d041-44aa-897a-a09957500801, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 2147483648" returned: 0 in 0.582s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801" returned: 0 in 0.488s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] <== create_volume: return (1191ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:57 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (f06a5b63-82e3-4f18-82bf-77c6ea11bde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886fabb1-4a09-49ac-ade0-cc202507b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54110758-eadc-4c5c-b777-42aed983d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fd003c-d041-44aa-897a-a09957500801', 'volume_size': 2}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32c511-5a51-4dbb-a105-b4b33118fc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (0cd04c67-7026-4c2f-917c-a5d92695f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5232ee63-e33c-40e7-b6bb-0d379d329b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886fabb1-4a09-49ac-ade0-cc202507b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221864719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e4dc9-5eee-4337-8d6d-482f8a9a4f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:57Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01652e0c-6121-4aae-b0d9-98d24cdea3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01652e0c-6121-4aae-b0d9-98d24cdea3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a9613-f2bb-4b8d-9fbb-806baf3d4ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4a9613-f2bb-4b8d-9fbb-806baf3d4ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513e4dc9-5eee-4337-8d6d-482f8a9a4f58', 'volume_name': 'volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a1287-5f82-4b38-aa78-41a0d802f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a1287-5f82-4b38-aa78-41a0d802f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902759c9-b023-4502-aa33-e3573570d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume 513e4dc9-5eee-4337-8d6d-482f8a9a4f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58', 'volume_size': 1}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1221864719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e4dc9-5eee-4337-8d6d-482f8a9a4f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:57Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume 513e4dc9-5eee-4337-8d6d-482f8a9a4f58 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:57 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:57 devstack quobyte-client[84528]: System call of process 93699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:57 devstack quobyte-client[84528]: System call of process 93699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:57 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=89, name=volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5232ee63-e33c-40e7-b6bb-0d379d329b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120625212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af6544b-bca5-4bfa-ab43-e356da6f6357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:57Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ec4db3-a0bd-4c85-849d-47a863c9eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ec4db3-a0bd-4c85-849d-47a863c9eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aa2cec-d92d-4a8c-90ac-a98e428026c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8aa2cec-d92d-4a8c-90ac-a98e428026c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af6544b-bca5-4bfa-ab43-e356da6f6357', 'volume_name': 'volume-1af6544b-bca5-4bfa-ab43-e356da6f6357', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757312d5-728b-4f0d-8370-6f53c3a60549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757312d5-728b-4f0d-8370-6f53c3a60549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da439d48-a040-4a31-8824-5769622af370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:58 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume 1af6544b-bca5-4bfa-ab43-e356da6f6357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af6544b-bca5-4bfa-ab43-e356da6f6357', 'volume_size': 1}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:58 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume volume-b0fd003c-d041-44aa-897a-a09957500801 (b0fd003c-d041-44aa-897a-a09957500801): created successfully
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32c511-5a51-4dbb-a105-b4b33118fc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Flow 'volume_create_manager' (78413ff3-07d6-40ac-ac3b-84b2e079b196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 1073741824" returned: 0 in 0.916s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-13dc1714-c8df-4cda-b460-f6f4db97d096 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Created volume successfully.
Sep 24 17:57:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (a2bca1f8-84bb-41a1-8f3b-ea45528b2e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd67d74a-1bcb-4d9d-bba5-c4860797d328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (d3576f49-a447-4368-905f-17f775425cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75aaf082-2f0f-4a3e-9337-7e4be948e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75aaf082-2f0f-4a3e-9337-7e4be948e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476706870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880a0159-c8bb-4935-a452-00faffad1f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:58Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38472b12-f3f5-4876-80a2-47f2d16615da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38472b12-f3f5-4876-80a2-47f2d16615da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa69cc21-f064-4618-ad18-37c03d900333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa69cc21-f064-4618-ad18-37c03d900333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '880a0159-c8bb-4935-a452-00faffad1f2a', 'volume_name': 'volume-880a0159-c8bb-4935-a452-00faffad1f2a', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369bf465-37c0-4706-8e4e-764b8ccd5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (369bf465-37c0-4706-8e4e-764b8ccd5e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83b536-f98a-467b-b142-d9f543674006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:57:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume 880a0159-c8bb-4935-a452-00faffad1f2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-880a0159-c8bb-4935-a452-00faffad1f2a', 'volume_size': 1}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" returned: 0 in 0.928s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (1873ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.298s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120625212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af6544b-bca5-4bfa-ab43-e356da6f6357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:57Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume 1af6544b-bca5-4bfa-ab43-e356da6f6357 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:57:59 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:57:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:57:59 devstack quobyte-client[84528]: System call of process 93704 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:57:59 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=90, name=volume-1af6544b-bca5-4bfa-ab43-e356da6f6357, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd67d74a-1bcb-4d9d-bba5-c4860797d328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491250242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd9babd-9d54-4f06-9f9f-223d207b0297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:58Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899cb0e-4645-47ae-ae13-6b41f6c4cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1899cb0e-4645-47ae-ae13-6b41f6c4cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ec46f-a083-4adf-b579-86214468f202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ec46f-a083-4adf-b579-86214468f202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd9babd-9d54-4f06-9f9f-223d207b0297', 'volume_name': 'volume-2cd9babd-9d54-4f06-9f9f-223d207b0297', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c2d69-cb5b-4005-833d-0ffd29e10d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (825c2d69-cb5b-4005-833d-0ffd29e10d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8b0935-0047-4c1f-8749-5b2ab85fabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume 2cd9babd-9d54-4f06-9f9f-223d207b0297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd9babd-9d54-4f06-9f9f-223d207b0297', 'volume_size': 1}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902759c9-b023-4502-aa33-e3573570d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eab5bef-f629-4743-a52f-56a527ed4894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 1073741824" returned: 0 in 0.689s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 (513e4dc9-5eee-4337-8d6d-482f8a9a4f58): created successfully
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eab5bef-f629-4743-a52f-56a527ed4894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (f06a5b63-82e3-4f18-82bf-77c6ea11bde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6119eca0-8e5a-44e6-bfb0-37f5b5032fd3 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:58:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (6b729736-e1a2-4d82-8289-ef9c734a76e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6f0e7-4dd2-453d-84b6-a535a2144e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6f0e7-4dd2-453d-84b6-a535a2144e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644867776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0aa956-5a48-4c47-97ab-899d0169748e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:59Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb3085e-4180-403a-a7f1-e4b7f4a03ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb3085e-4180-403a-a7f1-e4b7f4a03ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db126f-b7a1-40a7-9392-97e88b746659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4db126f-b7a1-40a7-9392-97e88b746659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df0aa956-5a48-4c47-97ab-899d0169748e', 'volume_name': 'volume-df0aa956-5a48-4c47-97ab-899d0169748e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2f5c98-6f7f-4c4c-886f-1a833cc0fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2f5c98-6f7f-4c4c-886f-1a833cc0fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a730745b-50ca-4d2b-a880-8bccb92edc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:01 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume df0aa956-5a48-4c47-97ab-899d0169748e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df0aa956-5a48-4c47-97ab-899d0169748e', 'volume_size': 1}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357" returned: 0 in 0.772s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (1501ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-476706870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880a0159-c8bb-4935-a452-00faffad1f2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:58Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume 880a0159-c8bb-4935-a452-00faffad1f2a {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:58:01 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:01 devstack quobyte-client[84528]: System call of process 93708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:01 devstack quobyte-client[84528]: System call of process 93708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:01 devstack quobyte-client[84528]: System call of process 93708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:01 devstack quobyte-client[84528]: System call of process 93708 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:01 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=91, name=volume-880a0159-c8bb-4935-a452-00faffad1f2a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da439d48-a040-4a31-8824-5769622af370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af6544b-bca5-4bfa-ab43-e356da6f6357', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb731a69-3a1e-4eb3-8438-935dc1b4fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:01 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 (1af6544b-bca5-4bfa-ab43-e356da6f6357): created successfully
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb731a69-3a1e-4eb3-8438-935dc1b4fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (0cd04c67-7026-4c2f-917c-a5d92695f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a 1073741824" returned: 0 in 0.664s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a" returned: 0 in 0.173s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (927ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1491250242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd9babd-9d54-4f06-9f9f-223d207b0297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:58Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume 2cd9babd-9d54-4f06-9f9f-223d207b0297 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:58:02 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:02 devstack quobyte-client[84528]: System call of process 93713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4059b73d-6f30-42ee-acdc-ed97958c8503 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:58:02 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=92, name=volume-2cd9babd-9d54-4f06-9f9f-223d207b0297, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d83b536-f98a-467b-b142-d9f543674006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880a0159-c8bb-4935-a452-00faffad1f2a', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb84d2e4-ef79-4ab1-99a6-a5ad33c495b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:02 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-880a0159-c8bb-4935-a452-00faffad1f2a (880a0159-c8bb-4935-a452-00faffad1f2a): created successfully
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb84d2e4-ef79-4ab1-99a6-a5ad33c495b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (d3576f49-a447-4368-905f-17f775425cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 1073741824" returned: 0 in 0.662s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0ed1d20e-4f32-457a-a9f4-04489daed211 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297" returned: 0 in 0.325s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (1027ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.087s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Creating offline snapshot baa17155-761f-435b-82b6-d1bd033a6789 of volume b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8b0935-0047-4c1f-8749-5b2ab85fabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd9babd-9d54-4f06-9f9f-223d207b0297', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a053ccbe-b63b-4749-92a7-b2b4da014e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be99c5-6fcf-4c30-bab9-df1bbe0f7240]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:03 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 (2cd9babd-9d54-4f06-9f9f-223d207b0297): created successfully
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a053ccbe-b63b-4749-92a7-b2b4da014e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (a2bca1f8-84bb-41a1-8f3b-ea45528b2e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:04 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-aef3265c-ee74-440a-99d8-99396e6d065b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:58:04 devstack quobyte-client[84528]: System call of process 93717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801" returned: 0 in 0.701s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 2G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:04 devstack quobyte-client[84528]: System call of process 93720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:04 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=93, name=volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 2G" returned: 0 in 0.316s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b0fd003c-d041-44aa-897a-a09957500801 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:04 devstack quobyte-client[84528]: System call of process 93723 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "qemu-img rebase -u -b volume-b0fd003c-d041-44aa-897a-a09957500801 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.186s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:58:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.168s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.155s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.info" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.info" returned: 0 in 0.102s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.715s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-644867776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0aa956-5a48-4c47-97ab-899d0169748e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddef4032c9ac471b86c92ce0ba3f51d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:57:59Z,use_quota=True,user_id='345946fd8f2b4a9194ea355680508777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Creating volume df0aa956-5a48-4c47-97ab-899d0169748e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:58:05 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:58:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:05 devstack quobyte-client[84528]: System call of process 93730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:05 devstack quobyte-client[84528]: System call of process 93730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:05 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=95, name=volume-df0aa956-5a48-4c47-97ab-899d0169748e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e 1073741824" returned: 0 in 0.518s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-23aa0e1c-1c93-4b84-b0a9-62a0c04b5dff tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Create snapshot completed successfully
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e" returned: 0 in 0.432s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] <== create_volume: return (1012ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a730745b-50ca-4d2b-a880-8bccb92edc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0aa956-5a48-4c47-97ab-899d0169748e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1068d7-7fbd-497b-8bd2-35fbb451427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:07 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume volume-df0aa956-5a48-4c47-97ab-899d0169748e (df0aa956-5a48-4c47-97ab-899d0169748e): created successfully
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c1068d7-7fbd-497b-8bd2-35fbb451427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Flow 'volume_create_manager' (6b729736-e1a2-4d82-8289-ef9c734a76e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9e238fc9-a592-4b90-9e2a-be94ca8e260d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created volume successfully.
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "cinder-baa17155-761f-435b-82b6-d1bd033a6789-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-df0aa956-5a48-4c47-97ab-899d0169748e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-baa17155-761f-435b-82b6-d1bd033a6789-delete_snapshot" acquired by "delete_snapshot" :: waited 0.171s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-df0aa956-5a48-4c47-97ab-899d0169748e-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" acquired by "delete_snapshot" :: waited 0.078s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "cinder-quobyte-baa17155-761f-435b-82b6-d1bd033a6789" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-baa17155-761f-435b-82b6-d1bd033a6789" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Deleting offline snapshot baa17155-761f-435b-82b6-d1bd033a6789 of volume b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 17:58:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] snapshot_file for this snap is: volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2080668-03bb-4ddb-8cb8-e3bcdf4fc487]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-df0aa956-5a48-4c47-97ab-899d0169748e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-df0aa956-5a48-4c47-97ab-899d0169748e" acquired by "delete_volume" :: waited 0.133s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0513e893-6779-490a-967a-f2b00db3770f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.636s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fd003c-d041-44aa-897a-a09957500801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959c9ff-0ede-4c67-bc47-ddab11871a68]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:08 devstack quobyte-client[84528]: System call of process 93737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:08 devstack quobyte-client[84528]: System call of process 93737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e" returned: 0 in 0.725s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-df0aa956-5a48-4c47-97ab-899d0169748e" returned: 0 in 0.152s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-df0aa956-5a48-4c47-97ab-899d0169748e" released by "delete_volume" :: held 1.106s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:09 devstack quobyte-client[84528]: System call of process 93740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:09 devstack quobyte-client[84528]: System call of process 93740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801" returned: 0 in 0.920s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:09 devstack quobyte-client[84528]: System call of process 93746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:09 devstack quobyte-client[84528]: System call of process 93746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.444s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801.baa17155-761f-435b-82b6-d1bd033a6789" returned: 0 in 0.255s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-baa17155-761f-435b-82b6-d1bd033a6789" released by "_delete_snapshot" :: held 2.648s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['1553c582-9eee-4b13-819b-8b189743de5a', '88778aa7-14ee-4928-8ee9-afd53333c442', '4e5da866-c20d-425b-918e-98eb2d6a18d8', '0ef63bfb-7a82-4434-a528-591c73ac0491'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" released by "delete_snapshot" :: held 2.828s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Created reservations ['a06c5202-c45e-4e25-899a-6ffe14f2c436', '4ff0b672-a867-4a51-885e-37e0de82a585', '81c609c5-1d53-454d-b99c-fc49b72faf9e', '12100acd-0b8f-4b90-82e6-2da30f2e7af5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.328s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-880a0159-c8bb-4935-a452-00faffad1f2a-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-880a0159-c8bb-4935-a452-00faffad1f2a-delete_volume" acquired by "delete_volume" :: waited 0.155s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4e841f67-9e04-40ff-a43c-e76d038cfb3f tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-df0aa956-5a48-4c47-97ab-899d0169748e-delete_volume" released by "delete_volume" :: held 3.792s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-880a0159-c8bb-4935-a452-00faffad1f2a" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-880a0159-c8bb-4935-a452-00faffad1f2a" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Delete snapshot completed successfully.
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-19ac7061-349d-4094-8f1e-74421d2950ae tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-baa17155-761f-435b-82b6-d1bd033a6789-delete_snapshot" released by "delete_snapshot" :: held 4.045s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[647ca577-cb72-468c-a3b2-a546e0bd56a4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "cinder-b0fd003c-d041-44aa-897a-a09957500801-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-b0fd003c-d041-44aa-897a-a09957500801-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a" returned: 0 in 0.747s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-880a0159-c8bb-4935-a452-00faffad1f2a" returned: 0 in 0.225s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" acquired by "delete_volume" :: waited 0.297s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-880a0159-c8bb-4935-a452-00faffad1f2a" released by "delete_volume" :: held 1.121s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d0245-ddb0-47ff-84cd-f529d526d4ac]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['3684e684-9f3d-4652-80f7-254b18b58fae', '3a2ff8a9-7f9b-4bca-9db0-940c97f199c6', 'fe7922ff-4f55-4192-a9bd-145aa9c44c30', 'd5281476-5964-4e40-acf1-dd762ee4c22f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:13 devstack quobyte-client[84528]: System call of process 93756 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801" returned: 0 in 0.756s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.310s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-2cd9babd-9d54-4f06-9f9f-223d207b0297-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0fd003c-d041-44aa-897a-a09957500801" returned: 0 in 0.584s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-quobyte-b0fd003c-d041-44aa-897a-a09957500801" released by "delete_volume" :: held 1.605s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-2cd9babd-9d54-4f06-9f9f-223d207b0297-delete_volume" acquired by "delete_volume" :: waited 0.266s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8c1656a6-42b5-4c12-86c1-267510bc900b tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-880a0159-c8bb-4935-a452-00faffad1f2a-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-2cd9babd-9d54-4f06-9f9f-223d207b0297" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-2cd9babd-9d54-4f06-9f9f-223d207b0297" acquired by "delete_volume" :: waited 0.053s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Created reservations ['c9b72658-f819-4e99-afbc-11021fb76dc7', '8f82e00a-d6b4-4d30-80ff-5ff43824ef2c', '6d337a2a-99d0-4904-b994-9ac8e842a944', 'eac29293-6088-469c-ae74-cc5e11bd023a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10dc8bc-6885-47d7-a0bf-e45bd4f34a81]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.099s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.099s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297" returned: 0 in 1.342s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.575s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Deleted volume successfully.
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2cd9babd-9d54-4f06-9f9f-223d207b0297" returned: 0 in 1.327s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ccc51b7d-9ffe-43e5-970e-f9b31182c9d2 tempest-VolumesSnapshotNegativeTestJSON-1194605970 None] Lock "cinder-b0fd003c-d041-44aa-897a-a09957500801-delete_volume" released by "delete_volume" :: held 5.283s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.655s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-2cd9babd-9d54-4f06-9f9f-223d207b0297" released by "delete_volume" :: held 3.002s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['76ed99c2-5fff-4e39-9161-25e784d14aa8', '6edff4e8-d90f-48c4-948a-b483130f206a', 'e1c6fc96-b5c6-46e7-97e6-a6190ca60d5e', 'e8844a95-d18b-486b-a9e7-585e8784fe8b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.290s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-1af6544b-bca5-4bfa-ab43-e356da6f6357-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-026a0c96-88de-43d2-8d85-5b26d265777d tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-2cd9babd-9d54-4f06-9f9f-223d207b0297-delete_volume" released by "delete_volume" :: held 5.133s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-1af6544b-bca5-4bfa-ab43-e356da6f6357-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-1af6544b-bca5-4bfa-ab43-e356da6f6357" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-1af6544b-bca5-4bfa-ab43-e356da6f6357" acquired by "delete_volume" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f2c161-b88e-4762-aabc-6b0404b33cbb]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:20 devstack quobyte-client[84528]: System call of process 93785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:20 devstack quobyte-client[84528]: System call of process 93785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:20 devstack quobyte-client[84528]: System call of process 93785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357" returned: 0 in 1.054s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1af6544b-bca5-4bfa-ab43-e356da6f6357" returned: 0 in 0.142s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-1af6544b-bca5-4bfa-ab43-e356da6f6357" released by "delete_volume" :: held 1.469s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['2c7a4cd4-7076-4a13-9bd7-2803cbc51841', '45a8603e-211a-4400-882f-064f0985c1fd', 'fd85522b-d165-4bec-b796-06d71e60f64e', '3469279d-6340-44b8-b96f-ac5ba7c12728'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.208s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f605a9d4-88c3-4465-8ea7-fac74e21a4d9 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-1af6544b-bca5-4bfa-ab43-e356da6f6357-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-513e4dc9-5eee-4337-8d6d-482f8a9a4f58-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-513e4dc9-5eee-4337-8d6d-482f8a9a4f58-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb4a09-07e3-4673-8018-01b01a44c96e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" returned: 0 in 0.663s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" returned: 0 in 0.104s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-513e4dc9-5eee-4337-8d6d-482f8a9a4f58" released by "delete_volume" :: held 0.977s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=123,cinder:SELECT=64,cinder:DELETE=12,cinder:INSERT=30 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['6cc4a2f5-ed8f-4340-a5a0-6db3464962f5', 'ac39e95c-10e0-465a-b093-65a714083da0', '74a3a71a-4c75-45a0-bed3-ae2b30a34990', '95a989ff-eccf-4210-986b-4bd9950a3a7a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.108s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:24 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-b21bfd71-6868-40f2-8aa8-837419e15099-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-730abfe5-be90-42e8-b122-cfc531ad75e0 tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-513e4dc9-5eee-4337-8d6d-482f8a9a4f58-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-b21bfd71-6868-40f2-8aa8-837419e15099-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "cinder-quobyte-b21bfd71-6868-40f2-8aa8-837419e15099" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-b21bfd71-6868-40f2-8aa8-837419e15099" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1ca65-010d-488f-b90e-4a25e564e7e6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:26 devstack quobyte-client[84528]: System call of process 93833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:58:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099" returned: 0 in 0.665s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b21bfd71-6868-40f2-8aa8-837419e15099" returned: 0 in 0.199s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-quobyte-b21bfd71-6868-40f2-8aa8-837419e15099" released by "delete_volume" :: held 1.120s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Created reservations ['bc55cf2e-eea6-499f-a188-6bd60235e756', '8f15f803-c4c6-4016-a036-ad0c1e354107', '2100c321-eb91-4a1e-bf30-bf087b544ea7', '1086e7b9-347e-4cc4-bf16-ff3689249938'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.254s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:27 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:58:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Deleted volume successfully.
Sep 24 17:58:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7621b7fb-38cf-4ae3-8e5f-779022cb481e tempest-CreateVolumesFromSourceVolumeTest-1176351781 None] Lock "cinder-b21bfd71-6868-40f2-8aa8-837419e15099-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:58:37 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=124,cinder:DELETE=12,cinder:SELECT=87,cinder:INSERT=24 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:58:38 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:58:41 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Flow 'volume_create_manager' (d709802b-a772-4b95-9e78-b688b8742781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123fbdc9-c1e8-4a46-90e0-3cdaa14c6fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (123fbdc9-c1e8-4a46-90e0-3cdaa14c6fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045fd417-d19b-44f6-a86a-6d4101b08f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfccff19fc1f4a6cbe6d90a8d5c53761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:58:41Z,use_quota=True,user_id='c5a74893e30f4748811be133cc7f8132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789a3e8-252f-4ea6-9c11-9fb71eec1d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789a3e8-252f-4ea6-9c11-9fb71eec1d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94863a4-91ce-4ee9-844b-695b76e5a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:41 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94863a4-91ce-4ee9-844b-695b76e5a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '045fd417-d19b-44f6-a86a-6d4101b08f94', 'volume_name': 'volume-045fd417-d19b-44f6-a86a-6d4101b08f94', 'volume_size': 1, 'image_id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81f1e417879dcde4c1eeb5d2c0078f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dfccff19fc1f4a6cbe6d90a8d5c53761', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a82ac4da0a7ca4c7f28cf933a7ceb8d5b9e3b3e5f337c0ea7ce7afc6fe8c825e94665eb3ff17d4d9e17df57cc52ae42b933d142bc8a0abc28beb343e432b839b', 'id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'created_at': datetime.datetime(2025, 9, 24, 15, 58, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90fddba0>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f8f42b-0d48-4c0a-8fc8-99dba0270a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f8f42b-0d48-4c0a-8fc8-99dba0270a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39521c84-507f-4cf5-a0b0-87d89c507a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:58:42 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Volume 045fd417-d19b-44f6-a86a-6d4101b08f94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-045fd417-d19b-44f6-a86a-6d4101b08f94', 'volume_size': 1, 'image_id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81f1e417879dcde4c1eeb5d2c0078f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dfccff19fc1f4a6cbe6d90a8d5c53761', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a82ac4da0a7ca4c7f28cf933a7ceb8d5b9e3b3e5f337c0ea7ce7afc6fe8c825e94665eb3ff17d4d9e17df57cc52ae42b933d142bc8a0abc28beb343e432b839b', 'id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'created_at': datetime.datetime(2025, 9, 24, 15, 58, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90fddba0>}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Cloning 045fd417-d19b-44f6-a86a-6d4101b08f94 from image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de  at location (None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 17:58:42 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Image download 0.00 MB at 0.00 MB/s
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab26d3d-8907-4767-8067-42fb07238509]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:43 devstack sudo[93918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD
Sep 24 17:58:43 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:58:46 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root
Sep 24 17:58:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 0 in 3.560s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:47 devstack sudo[93922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD
Sep 24 17:58:47 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:58:49 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root
Sep 24 17:58:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 1 in 3.601s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:58:50 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Temporary image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de is fetched for user c5a74893e30f4748811be133cc7f8132. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 17:58:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919c7c4-464b-42f6-9ad0-9828d08ee3e1]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:58:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:51 devstack sudo[93928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD
Sep 24 17:58:51 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:58:56 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root
Sep 24 17:58:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 0 in 5.686s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:58:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:58:57 devstack sudo[93934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD
Sep 24 17:58:57 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 17:58:59 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 1 in 3.407s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045fd417-d19b-44f6-a86a-6d4101b08f94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfccff19fc1f4a6cbe6d90a8d5c53761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:58:41Z,use_quota=True,user_id='c5a74893e30f4748811be133cc7f8132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Creating volume 045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:59:00 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:00 devstack quobyte-client[84528]: System call of process 93944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:00 devstack quobyte-client[84528]: System call of process 93944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:00 devstack quobyte-client[84528]: System call of process 93944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:00 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=96, name=volume-045fd417-d19b-44f6-a86a-6d4101b08f94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:59:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 1073741824" returned: 0 in 0.800s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 0 in 0.359s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] <== create_volume: return (1309ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Attempting download of f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de ((None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}])) to volume 045fd417-d19b-44f6-a86a-6d4101b08f94. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9628b5d3-2e07-47ff-b995-94221e510ec6]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:59:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_uu5itk6s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_uu5itk6s" returned: 0 in 0.590s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_uu5itk6s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_uu5itk6s" returned: 1 in 0.443s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_uu5itk6s' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bae048-5529-402b-914d-938d95a3d7c2]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD" returned: 1 in 0.526s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de was raw, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:04 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=96, name=volume-045fd417-d19b-44f6-a86a-6d4101b08f94, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 0 in 0.271s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de_8s2if8w1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 17:59:04 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Converted 0.00 MB image at 0.00 MB/s
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 1G" returned: 0 in 0.232s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5519e3-930b-4070-b390-e0379530ed6a]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:59:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 0 in 0.497s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 1 in 0.498s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Downloaded image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de ((None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}])) to volume 045fd417-d19b-44f6-a86a-6d4101b08f94 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Temporary image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de for user c5a74893e30f4748811be133cc7f8132 is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Marking volume 045fd417-d19b-44f6-a86a-6d4101b08f94 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Copying metadata from image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de to 045fd417-d19b-44f6-a86a-6d4101b08f94. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Creating volume glance metadata for volume 045fd417-d19b-44f6-a86a-6d4101b08f94 backed by image f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de with: {'image_id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '81f1e417879dcde4c1eeb5d2c0078f81', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39521c84-507f-4cf5-a0b0-87d89c507a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045fd417-d19b-44f6-a86a-6d4101b08f94', 'volume_size': 1, 'image_id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '81f1e417879dcde4c1eeb5d2c0078f81', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dfccff19fc1f4a6cbe6d90a8d5c53761', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a82ac4da0a7ca4c7f28cf933a7ceb8d5b9e3b3e5f337c0ea7ce7afc6fe8c825e94665eb3ff17d4d9e17df57cc52ae42b933d142bc8a0abc28beb343e432b839b', 'id': 'f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de', 'created_at': datetime.datetime(2025, 9, 24, 15, 58, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 58, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f04c5cc7-a3ac-4ffc-9ec6-20bae21ee3de/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90fddba0>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7b668c-aaaf-4fe1-9851-d1d2a450d8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:06 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Volume volume-045fd417-d19b-44f6-a86a-6d4101b08f94 (045fd417-d19b-44f6-a86a-6d4101b08f94): created successfully
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7b668c-aaaf-4fe1-9851-d1d2a450d8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Flow 'volume_create_manager' (d709802b-a772-4b95-9e78-b688b8742781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:59:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-369ed5cb-aa71-461a-a3a3-3d32da0febd4 tempest-VolumeImageDependencyTests-242477982 None] Created volume successfully.
Sep 24 17:59:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Acquiring lock "cinder-045fd417-d19b-44f6-a86a-6d4101b08f94-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:59:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "cinder-045fd417-d19b-44f6-a86a-6d4101b08f94-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:59:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:59:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Acquiring lock "cinder-quobyte-045fd417-d19b-44f6-a86a-6d4101b08f94" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 17:59:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "cinder-quobyte-045fd417-d19b-44f6-a86a-6d4101b08f94" acquired by "delete_volume" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 17:59:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdae1b4-c1d0-422d-a67b-2703a93b47a9]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:59:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:08 devstack quobyte-client[84528]: System call of process 93997 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 0 in 0.629s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 1 in 1.035s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 17:59:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-045fd417-d19b-44f6-a86a-6d4101b08f94" returned: 0 in 0.312s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "cinder-quobyte-045fd417-d19b-44f6-a86a-6d4101b08f94" released by "delete_volume" :: held 2.405s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:59:10 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Created reservations ['73f1fbe6-70d0-498d-831c-67cd3eb0deb5', 'f8099959-fe2a-4bba-8786-5bbd232b8eb2', '8529ce0c-8a6b-4e05-b65c-76199da4c0c0', 'ab15c361-55a3-4430-b60f-b18abdeb88a8'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.202s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:11 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:59:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Deleted volume successfully.
Sep 24 17:59:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7e3fb238-6fb4-4e1e-b5cd-570e5b1acade tempest-VolumeImageDependencyTests-242477982 None] Lock "cinder-045fd417-d19b-44f6-a86a-6d4101b08f94-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 17:59:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 17:59:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:59:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:59:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.237s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 17:59:21 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=13,cinder:INSERT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:59:21 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=18,cinder:INSERT=4,cinder:SELECT=6,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 17:59:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (7fc6dfd0-04ae-4d7d-ad56-07ab79376417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ee852-56a8-4cf6-9c30-e5309ad505d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ee852-56a8-4cf6-9c30-e5309ad505d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2135863606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7647462-8fe6-4578-9405-c316c18a4c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:59:45Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a54195-37ca-4f4a-94b0-2015caa07465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a54195-37ca-4f4a-94b0-2015caa07465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e011eb-4de4-44e7-892a-b0cd0eec4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e011eb-4de4-44e7-892a-b0cd0eec4c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7647462-8fe6-4578-9405-c316c18a4c4b', 'volume_name': 'volume-e7647462-8fe6-4578-9405-c316c18a4c4b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fab6c-7134-47f6-8c5d-1be9d4270df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f60fab6c-7134-47f6-8c5d-1be9d4270df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11049cd8-7d05-49a8-a26e-bed8daae718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:45 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Volume e7647462-8fe6-4578-9405-c316c18a4c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7647462-8fe6-4578-9405-c316c18a4c4b', 'volume_size': 1}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2135863606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7647462-8fe6-4578-9405-c316c18a4c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:59:45Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Creating volume e7647462-8fe6-4578-9405-c316c18a4c4b {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:59:45 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:45 devstack quobyte-client[84528]: System call of process 94170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:45 devstack quobyte-client[84528]: System call of process 94170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:45 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=97, name=volume-e7647462-8fe6-4578-9405-c316c18a4c4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b 1073741824" returned: 0 in 0.452s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b" returned: 0 in 0.148s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11049cd8-7d05-49a8-a26e-bed8daae718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7647462-8fe6-4578-9405-c316c18a4c4b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5101b3ba-4857-4db8-babb-54bda99dc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Volume volume-e7647462-8fe6-4578-9405-c316c18a4c4b (e7647462-8fe6-4578-9405-c316c18a4c4b): created successfully
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5101b3ba-4857-4db8-babb-54bda99dc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (7fc6dfd0-04ae-4d7d-ad56-07ab79376417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:59:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b32fbc3e-a4d6-4bd6-a4b6-ca16c7724198 tempest-AttachVolumeTestJSON-39313904 None] Created volume successfully.
Sep 24 17:59:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[957cba99-e76c-407b-8eb6-e4c318484d6a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 17:59:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:52 devstack quobyte-client[84528]: System call of process 94182 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b" returned: 0 in 0.918s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 17:59:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.077s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-e7647462-8fe6-4578-9405-c316c18a4c4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '615973d7-9ae8-41d7-8888-0dcb92862e16', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 17:59:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:59:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-3c8b34ab-3b8b-44fd-9c6c-877e26c86907 req-6f808850-7826-4c2d-9c76-a59f51b64f05 tempest-AttachVolumeTestJSON-39313904 None] attachment_update completed successfully.
Sep 24 17:59:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (76f38854-1107-4b14-ac4f-465857e7ac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2d1355-f3ab-465e-ab4b-86411b76c764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2d1355-f3ab-465e-ab4b-86411b76c764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765614698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18216157-d2e2-4f8f-ab8e-3047fca5b1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:59:59Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5913ff1-183e-4fbe-8731-f85e7910ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5913ff1-183e-4fbe-8731-f85e7910ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b035b2-e7e7-43ac-b315-210f225f4ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b035b2-e7e7-43ac-b315-210f225f4ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18216157-d2e2-4f8f-ab8e-3047fca5b1ea', 'volume_name': 'volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c833444-5403-4778-a8c5-53987930c2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c833444-5403-4778-a8c5-53987930c2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a867a7e5-e1b8-4b7a-8ddd-e31cec0011b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 17:59:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Volume 18216157-d2e2-4f8f-ab8e-3047fca5b1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea', 'volume_size': 1}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T15:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1765614698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18216157-d2e2-4f8f-ab8e-3047fca5b1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934211cbb1d54775b52c6e72fe04d05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T15:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T15:59:59Z,use_quota=True,user_id='27b8fad33e58473b900db328cf20ce7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Creating volume 18216157-d2e2-4f8f-ab8e-3047fca5b1ea {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 17:59:59 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 17:59:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 17:59:59 devstack quobyte-client[84528]: System call of process 94580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:59 devstack quobyte-client[84528]: System call of process 94580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 17:59:59 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=98, name=volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea 1073741824" returned: 0 in 0.387s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" returned: 0 in 0.106s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] <== create_volume: return (571ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a867a7e5-e1b8-4b7a-8ddd-e31cec0011b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4b4a18-6744-4741-89fa-5f9222c40aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Volume volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea (18216157-d2e2-4f8f-ab8e-3047fca5b1ea): created successfully
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4b4a18-6744-4741-89fa-5f9222c40aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Flow 'volume_create_manager' (76f38854-1107-4b14-ac4f-465857e7ac39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:00:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-35b00a94-d80b-4226-b776-e29413267f7d tempest-AttachVolumeTestJSON-39313904 None] Created volume successfully.
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1fd40-18e4-408c-8f36-ab8ae584c600]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:05 devstack quobyte-client[84528]: System call of process 94620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" returned: 0 in 0.510s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.569s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '749c3ff8-aced-40c6-ae97-a00737ec7ff5', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:00:06 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-174d62ff-38a5-4a2b-ad9a-fc421a33d1aa req-cac34d6f-ccca-41f1-bd5f-db90f755bed6 tempest-AttachVolumeTestJSON-39313904 None] attachment_update completed successfully.
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=4,cinder:SELECT=16,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.102s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:00:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4b6c0550-f0f4-454f-9881-2e3ba1c99368 req-366226aa-318a-4d9b-9139-225aaa6ca9b3 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4b6c0550-f0f4-454f-9881-2e3ba1c99368 req-366226aa-318a-4d9b-9139-225aaa6ca9b3 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:35 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4b6c0550-f0f4-454f-9881-2e3ba1c99368 req-366226aa-318a-4d9b-9139-225aaa6ca9b3 tempest-AttachVolumeTestJSON-39313904 None] Terminate volume connection completed successfully.
Sep 24 18:00:35 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4b6c0550-f0f4-454f-9881-2e3ba1c99368 req-366226aa-318a-4d9b-9139-225aaa6ca9b3 tempest-AttachVolumeTestJSON-39313904 None] Deleting attachment 615973d7-9ae8-41d7-8888-0dcb92862e16. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:00:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Flow 'volume_create_manager' (deb41093-2a27-4f9c-996a-20a9e1042b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bafeb4-1b79-4dba-b8e7-378e39852a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36bafeb4-1b79-4dba-b8e7-378e39852a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-277484496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa431547-7d31-4fc3-9350-67716803b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78204a6feb504c8e9508fd8a2bb0a6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:00:42Z,use_quota=True,user_id='2169921ccb734fd185e9b9ca9b7d8311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fcde20-1d80-4b53-ad58-78e2424c2378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fcde20-1d80-4b53-ad58-78e2424c2378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e009a851-302e-445c-af59-6b1f13e6bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e009a851-302e-445c-af59-6b1f13e6bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa431547-7d31-4fc3-9350-67716803b0a3', 'volume_name': 'volume-fa431547-7d31-4fc3-9350-67716803b0a3', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2f6809-f6de-4e66-b384-60cc3e92875b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2f6809-f6de-4e66-b384-60cc3e92875b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d414f774-8aaf-41a1-aec3-9048744f1cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:42 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume fa431547-7d31-4fc3-9350-67716803b0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa431547-7d31-4fc3-9350-67716803b0a3', 'volume_size': 1}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-277484496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa431547-7d31-4fc3-9350-67716803b0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78204a6feb504c8e9508fd8a2bb0a6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:00:42Z,use_quota=True,user_id='2169921ccb734fd185e9b9ca9b7d8311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Creating volume fa431547-7d31-4fc3-9350-67716803b0a3 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:00:42 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:42 devstack quobyte-client[84528]: System call of process 94739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:00:42 devstack quobyte-client[84528]: System call of process 94739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:00:42 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=99, name=volume-fa431547-7d31-4fc3-9350-67716803b0a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 1073741824" returned: 0 in 0.365s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d414f774-8aaf-41a1-aec3-9048744f1cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa431547-7d31-4fc3-9350-67716803b0a3', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b670b67-b627-4b57-9d1b-8eba2693c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:00:43 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume volume-fa431547-7d31-4fc3-9350-67716803b0a3 (fa431547-7d31-4fc3-9350-67716803b0a3): created successfully
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b670b67-b627-4b57-9d1b-8eba2693c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:00:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Flow 'volume_create_manager' (deb41093-2a27-4f9c-996a-20a9e1042b33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:00:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-77baa889-22a9-4b7b-9aa3-11ce3ee83b91 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Created volume successfully.
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a363d47a-7d16-471c-9ba4-df23d45934bb]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3" returned: 0 in 0.391s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.451s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:00:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-fa431547-7d31-4fc3-9350-67716803b0a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd26f624-5b6a-41ad-860d-ff5f225ba92c', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:00:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-61782dde-da67-423a-a5f1-cfaae3931350 req-eb36e824-ec04-4f82-ade0-a1a04e5717e1 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] attachment_update completed successfully.
Sep 24 18:00:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4a62c32f-08b1-40c8-b47b-6e57d12660bb req-4b020d5d-78f1-47af-a71c-99dad6ba3326 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4a62c32f-08b1-40c8-b47b-6e57d12660bb req-4b020d5d-78f1-47af-a71c-99dad6ba3326 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:00:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4a62c32f-08b1-40c8-b47b-6e57d12660bb req-4b020d5d-78f1-47af-a71c-99dad6ba3326 tempest-AttachVolumeTestJSON-39313904 None] Terminate volume connection completed successfully.
Sep 24 18:00:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4a62c32f-08b1-40c8-b47b-6e57d12660bb req-4b020d5d-78f1-47af-a71c-99dad6ba3326 tempest-AttachVolumeTestJSON-39313904 None] Deleting attachment 749c3ff8-aced-40c6-ae97-a00737ec7ff5. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:01:08 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:08 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-18216157-d2e2-4f8f-ab8e-3047fca5b1ea-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-18216157-d2e2-4f8f-ab8e-3047fca5b1ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-quobyte-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" acquired by "delete_volume" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadacba4-2989-4641-b989-a670bb1f9310]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:01:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:11 devstack quobyte-client[84528]: System call of process 94818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" returned: 0 in 0.429s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" returned: 0 in 0.102s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-18216157-d2e2-4f8f-ab8e-3047fca5b1ea" released by "delete_volume" :: held 0.717s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Created reservations ['4543f3cd-ace3-4a97-8349-2b24a79f0daa', 'fa208a11-0b80-4a1e-a262-22f1bf725652', '0449db1f-36bc-4b75-9f7c-fa42ad7d6629', '5e44ee76-606c-4d10-96c1-4d4d6474b7fa'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.089s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:12 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Deleted volume successfully.
Sep 24 18:01:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7696b84b-145c-4f5e-b1ea-99e100f502d2 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-18216157-d2e2-4f8f-ab8e-3047fca5b1ea-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-e7647462-8fe6-4578-9405-c316c18a4c4b-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-e7647462-8fe6-4578-9405-c316c18a4c4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:13 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-quobyte-e7647462-8fe6-4578-9405-c316c18a4c4b" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-e7647462-8fe6-4578-9405-c316c18a4c4b" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77df20-2620-4367-a29d-a0bbb0140e24]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:13 devstack quobyte-client[84528]: System call of process 94830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b" returned: 0 in 0.658s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e7647462-8fe6-4578-9405-c316c18a4c4b" returned: 0 in 0.101s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-e7647462-8fe6-4578-9405-c316c18a4c4b" released by "delete_volume" :: held 0.993s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Created reservations ['a54cda27-f852-4bcb-8a65-956ddbab7eee', '9565ff28-7560-4bd6-bc52-4b48de19f2d5', 'a54a0a6e-9bcb-4078-b524-1926ef4b3ddf', '26e1c2ea-2a4b-4e19-a9fe-cae216d1b6ff'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.089s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:14 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Deleted volume successfully.
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-945317d1-0941-4193-b94f-959468a01ee5 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-e7647462-8fe6-4578-9405-c316c18a4c4b-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-d67f5ddd-a57f-420c-89ac-da732c92ef9e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-d67f5ddd-a57f-420c-89ac-da732c92ef9e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:15 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "cinder-quobyte-d67f5ddd-a57f-420c-89ac-da732c92ef9e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-d67f5ddd-a57f-420c-89ac-da732c92ef9e" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6c68a-ac0d-46ea-906e-96a8e28f0676]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:01:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:16 devstack quobyte-client[84528]: System call of process 94836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e" returned: 0 in 0.413s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d67f5ddd-a57f-420c-89ac-da732c92ef9e" returned: 0 in 0.105s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-quobyte-d67f5ddd-a57f-420c-89ac-da732c92ef9e" released by "delete_volume" :: held 0.684s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Created reservations ['770ed4bd-1cfd-4ba7-95e8-cf3f3ef03470', 'abde1edb-ab50-48b1-b7c7-fea6893dccd0', '4d98a882-b427-4f4d-98fa-7649f4cc4612', '8c502f49-7e5f-4a92-961e-89237658cd50'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.081s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Deleted volume successfully.
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.170s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1fe4c90e-fe66-46bc-bc47-36270bd82f53 tempest-AttachVolumeTestJSON-39313904 None] Lock "cinder-d67f5ddd-a57f-420c-89ac-da732c92ef9e-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:17 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-29b190bf-319b-4185-a4b2-6d5df22950a4 req-387c7522-9d2c-4033-9bf6-8bea2f17e3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:17 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-29b190bf-319b-4185-a4b2-6d5df22950a4 req-387c7522-9d2c-4033-9bf6-8bea2f17e3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-29b190bf-319b-4185-a4b2-6d5df22950a4 req-387c7522-9d2c-4033-9bf6-8bea2f17e3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Terminate volume connection completed successfully.
Sep 24 18:01:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-29b190bf-319b-4185-a4b2-6d5df22950a4 req-387c7522-9d2c-4033-9bf6-8bea2f17e3d9 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Deleting attachment cd26f624-5b6a-41ad-860d-ff5f225ba92c. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:01:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "cinder-fa431547-7d31-4fc3-9350-67716803b0a3-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "cinder-fa431547-7d31-4fc3-9350-67716803b0a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:20 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "cinder-quobyte-fa431547-7d31-4fc3-9350-67716803b0a3" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "cinder-quobyte-fa431547-7d31-4fc3-9350-67716803b0a3" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[41435399-0924-4dce-a6e9-4c98db30dd64]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:20 devstack quobyte-client[84528]: System call of process 94845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:20 devstack quobyte-client[84528]: System call of process 94845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:20 devstack quobyte-client[84528]: System call of process 94845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:20 devstack quobyte-client[84528]: System call of process 94845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:20 devstack quobyte-client[84528]: System call of process 94845 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3" returned: 0 in 0.674s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fa431547-7d31-4fc3-9350-67716803b0a3" returned: 0 in 0.156s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "cinder-quobyte-fa431547-7d31-4fc3-9350-67716803b0a3" released by "delete_volume" :: held 1.080s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Created reservations ['9099e8cc-cfee-4b21-9e73-cb91e4a84ab2', 'd54a4e4e-0bce-4f8f-acb5-dc337cd55372', '15dd3c9c-4351-4a7c-a293-d8badeea4429', '70d483ea-ef9c-41ad-b1eb-dde36bd58f2b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.105s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:21 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:21 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Deleted volume successfully.
Sep 24 18:01:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f549cc75-b05c-4aba-8f5f-a352bdfd10b5 tempest-TestServerVolumeAttachScenarioOldVersion-1734272315 None] Lock "cinder-fa431547-7d31-4fc3-9350-67716803b0a3-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:01:31 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=33,cinder:SELECT=26,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:32 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=31,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (6f2007ce-8e93-4439-bc1e-5ff20333875c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de02d0a3-88ef-431e-aa5e-2c6d1d1f3812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de02d0a3-88ef-431e-aa5e-2c6d1d1f3812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313385539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db58a3-e47b-48de-b788-dd9f5e784953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:48Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888967c8-4fc3-458b-8951-8b4d35ea82cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888967c8-4fc3-458b-8951-8b4d35ea82cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a887d7a-963f-46a1-a03e-372600234e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a887d7a-963f-46a1-a03e-372600234e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2db58a3-e47b-48de-b788-dd9f5e784953', 'volume_name': 'volume-b2db58a3-e47b-48de-b788-dd9f5e784953', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc24022-982d-408a-8f2d-f48fd517c5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc24022-982d-408a-8f2d-f48fd517c5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b4ac54-f6eb-494e-8e4d-5e079b60ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:48 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume b2db58a3-e47b-48de-b788-dd9f5e784953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2db58a3-e47b-48de-b788-dd9f5e784953', 'volume_size': 1}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313385539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2db58a3-e47b-48de-b788-dd9f5e784953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:48Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:01:48 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:01:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:48 devstack quobyte-client[84528]: System call of process 94931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:48 devstack quobyte-client[84528]: System call of process 94931 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:48 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=100, name=volume-b2db58a3-e47b-48de-b788-dd9f5e784953, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 1073741824" returned: 0 in 0.394s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953" returned: 0 in 0.125s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (596ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.608s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b4ac54-f6eb-494e-8e4d-5e079b60ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2db58a3-e47b-48de-b788-dd9f5e784953', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86061b-f31d-4c15-8ce8-a2fbcce2b2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:49 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-b2db58a3-e47b-48de-b788-dd9f5e784953 (b2db58a3-e47b-48de-b788-dd9f5e784953): created successfully
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b86061b-f31d-4c15-8ce8-a2fbcce2b2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:49 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (6f2007ce-8e93-4439-bc1e-5ff20333875c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d356f287-d2c7-40d1-ad44-24a5eec7c774 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:01:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating offline snapshot 85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 of volume b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c7c501-3308-4c26-92b2-fa6a5c6b664b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953" returned: 0 in 0.424s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:51 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=101, name=volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 1G" returned: 0 in 0.264s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b2db58a3-e47b-48de-b788-dd9f5e784953 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:51 devstack quobyte-client[84528]: System call of process 94941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:51 devstack quobyte-client[84528]: System call of process 94941 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img rebase -u -b volume-b2db58a3-e47b-48de-b788-dd9f5e784953 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.162s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:01:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.104s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.info" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.info" returned: 0 in 0.098s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.573s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fdc11db6-4643-4284-8565-fce0f64d2753 tempest-CreateVolumesFromSnapshotTest-909698510 None] Create snapshot completed successfully
Sep 24 18:01:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (40c76b1f-0eb8-4aa2-b7c6-1bba0aba5d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61be4da4-a26d-45d1-8d24-aca95bdfc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61be4da4-a26d-45d1-8d24-aca95bdfc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345414661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aafd60-2a95-4898-bb32-5ab0a18678ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:53Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e70a4b7-973e-4dc8-aca1-945b89c7b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e70a4b7-973e-4dc8-aca1-945b89c7b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50436607-933a-404a-813b-cf11bfbac09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50436607-933a-404a-813b-cf11bfbac09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9aafd60-2a95-4898-bb32-5ab0a18678ff', 'volume_name': 'volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e5e73-efac-49c8-9a6e-fdecef06fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94e5e73-efac-49c8-9a6e-fdecef06fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb611023-8161-47a4-8f6f-62dc5c135a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume b9aafd60-2a95-4898-bb32-5ab0a18678ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff', 'volume_size': 1}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345414661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9aafd60-2a95-4898-bb32-5ab0a18678ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:53Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume b9aafd60-2a95-4898-bb32-5ab0a18678ff {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:01:53 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:01:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:53 devstack quobyte-client[84528]: System call of process 94949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:54 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=103, name=volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff 1073741824" returned: 0 in 0.900s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:54 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:54 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (7dba9f90-35c8-4e5d-af1d-2e779724d9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81854bb-e4a0-40ae-b7a7-ae7987c778b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff" returned: 0 in 0.861s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81854bb-e4a0-40ae-b7a7-ae7987c778b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829451642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5822e7-acd7-4724-a4c7-6bd6245d1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:54Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4d1787-bc1b-4727-b95e-9d6d6938a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4d1787-bc1b-4727-b95e-9d6d6938a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6224bb57-7711-4ae3-b942-662823eb0d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6224bb57-7711-4ae3-b942-662823eb0d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a5822e7-acd7-4724-a4c7-6bd6245d1da5', 'volume_name': 'volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a6d47-5511-44d9-8781-cc520b81fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509a6d47-5511-44d9-8781-cc520b81fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e4c288-573d-4226-9f14-70e96f9e13d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:55 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume 4a5822e7-acd7-4724-a4c7-6bd6245d1da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5', 'volume_size': 1}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (1917ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829451642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a5822e7-acd7-4724-a4c7-6bd6245d1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:54Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume 4a5822e7-acd7-4724-a4c7-6bd6245d1da5 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:01:55 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:01:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:55 devstack quobyte-client[84528]: System call of process 94956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:55 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=104, name=volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (7ee6ea82-cc45-40a0-8e44-9eeace7f3ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8575f4d-6d08-4210-9a7d-b04cce196da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (bfd433fb-e71a-41ab-aa1a-77310d810787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38913da8-cd7f-4778-aaf5-ca4a1782d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb611023-8161-47a4-8f6f-62dc5c135a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8adf4-d6af-41f3-a9c5-f31b10afdb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38913da8-cd7f-4778-aaf5-ca4a1782d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463999360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d6310f-13d2-464e-ab6c-5930ecfb4a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:55Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7492ae-9ca8-4003-aaa6-32f861ce45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7492ae-9ca8-4003-aaa6-32f861ce45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f31ae5f-1f38-428c-bf51-bd5ead3cf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f31ae5f-1f38-428c-bf51-bd5ead3cf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d6310f-13d2-464e-ab6c-5930ecfb4a42', 'volume_name': 'volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3359aaf-1e81-4670-b600-81e76b86f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3359aaf-1e81-4670-b600-81e76b86f09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaa86ab-f2d8-4c04-b155-6c8fb4b28e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume e9d6310f-13d2-464e-ab6c-5930ecfb4a42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42', 'volume_size': 1}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8575f4d-6d08-4210-9a7d-b04cce196da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865321622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bb6d5-38bf-46b0-876d-3ded5a6b83aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:55Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da993b9f-d2c5-4d03-b670-2a36fbc20fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da993b9f-d2c5-4d03-b670-2a36fbc20fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0e6873-ff94-44f0-b121-7d39ce406208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0e6873-ff94-44f0-b121-7d39ce406208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '475bb6d5-38bf-46b0-876d-3ded5a6b83aa', 'volume_name': 'volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1b804-f1ff-4e5f-8aae-addbfc0c0c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1b804-f1ff-4e5f-8aae-addbfc0c0c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ae0bb2-333d-44dc-a585-dd5d7ae35ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume 475bb6d5-38bf-46b0-876d-3ded5a6b83aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa', 'volume_size': 1}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 1073741824" returned: 0 in 1.288s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff (b9aafd60-2a95-4898-bb32-5ab0a18678ff): created successfully
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8adf4-d6af-41f3-a9c5-f31b10afdb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (40c76b1f-0eb8-4aa2-b7c6-1bba0aba5d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:57 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (4c6d50c8-64be-44a5-a0f8-d4df61016ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539957e8-f3a8-4f41-b087-06d7c23f4c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" returned: 0 in 1.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (2498ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.526s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1463999360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d6310f-13d2-464e-ab6c-5930ecfb4a42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:55Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume e9d6310f-13d2-464e-ab6c-5930ecfb4a42 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:01:58 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-959f7037-4340-4452-b799-b16b85d92942 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:01:58 devstack quobyte-client[84528]: System call of process 94977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:58 devstack quobyte-client[84528]: System call of process 94977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:58 devstack quobyte-client[84528]: System call of process 94977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:58 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=105, name=volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539957e8-f3a8-4f41-b087-06d7c23f4c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321332391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1885792-d8f0-4b49-8161-5ea2dc0420bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:56Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0476cc34-aa09-4d37-9e06-cffe93cab2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0476cc34-aa09-4d37-9e06-cffe93cab2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e468d861-be7a-448f-8563-c662784a782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e468d861-be7a-448f-8563-c662784a782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1885792-d8f0-4b49-8161-5ea2dc0420bd', 'volume_name': 'volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280f0f6-262e-4017-bbbb-26ec0a23a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280f0f6-262e-4017-bbbb-26ec0a23a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a128a9d-f27a-4d82-8ff1-30130d7a55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:58 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume a1885792-d8f0-4b49-8161-5ea2dc0420bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd', 'volume_size': 1}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e4c288-573d-4226-9f14-70e96f9e13d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06421215-05be-4cdf-9f71-b8bde840ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 1073741824" returned: 0 in 0.756s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 (4a5822e7-acd7-4724-a4c7-6bd6245d1da5): created successfully
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06421215-05be-4cdf-9f71-b8bde840ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (7dba9f90-35c8-4e5d-af1d-2e779724d9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" returned: 0 in 0.386s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (1185ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.394s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865321622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=475bb6d5-38bf-46b0-876d-3ded5a6b83aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:55Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume 475bb6d5-38bf-46b0-876d-3ded5a6b83aa {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:01:59 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:59 devstack quobyte-client[84528]: System call of process 94983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:59 devstack quobyte-client[84528]: System call of process 94983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:59 devstack quobyte-client[84528]: System call of process 94983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:01:59 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=106, name=volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaa86ab-f2d8-4c04-b155-6c8fb4b28e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b78dd-2382-474c-bb56-994cdc9a0bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:01:59 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-295019e6-25cc-4f5f-923d-f7a03c02fdc5 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:01:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 (e9d6310f-13d2-464e-ab6c-5930ecfb4a42): created successfully
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1b78dd-2382-474c-bb56-994cdc9a0bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (bfd433fb-e71a-41ab-aa1a-77310d810787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa 1073741824" returned: 0 in 0.467s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-be7e4808-f868-418d-b787-b5343898944a tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" returned: 0 in 0.277s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (782ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321332391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1885792-d8f0-4b49-8161-5ea2dc0420bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf43b2ac04d4ace9797b3ca50465cc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:01:56Z,use_quota=True,user_id='d6ecab30728044ce9746e1e005615753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Creating volume a1885792-d8f0-4b49-8161-5ea2dc0420bd {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:02:00 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:00 devstack quobyte-client[84528]: System call of process 94987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:00 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=107, name=volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ae0bb2-333d-44dc-a585-dd5d7ae35ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04403aee-4cb0-4cce-9984-9ce14bd30cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd 1073741824" returned: 0 in 0.520s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa (475bb6d5-38bf-46b0-876d-3ded5a6b83aa): created successfully
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04403aee-4cb0-4cce-9984-9ce14bd30cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (7ee6ea82-cc45-40a0-8e44-9eeace7f3ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:02:01 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9c48d9de-0ca0-4fca-b0e3-bcb23aa5d1c0 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd" returned: 0 in 0.332s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] <== create_volume: return (907ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a128a9d-f27a-4d82-8ff1-30130d7a55fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da956c27-b431-42bc-98e0-459509933470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:02:01 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd (a1885792-d8f0-4b49-8161-5ea2dc0420bd): created successfully
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da956c27-b431-42bc-98e0-459509933470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Flow 'volume_create_manager' (4c6d50c8-64be-44a5-a0f8-d4df61016ac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:02:01 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8dab2ead-6ab7-43fa-808a-fb28c7deaaab tempest-CreateVolumesFromSnapshotTest-909698510 None] Created volume successfully.
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-a1885792-d8f0-4b49-8161-5ea2dc0420bd-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-a1885792-d8f0-4b49-8161-5ea2dc0420bd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-a1885792-d8f0-4b49-8161-5ea2dc0420bd" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-a1885792-d8f0-4b49-8161-5ea2dc0420bd" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5538479-a173-4594-ab04-4a15a5edb009]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd" returned: 0 in 0.476s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1885792-d8f0-4b49-8161-5ea2dc0420bd" returned: 0 in 0.110s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-a1885792-d8f0-4b49-8161-5ea2dc0420bd" released by "delete_volume" :: held 0.779s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['bf361032-5872-4bb2-85de-9974a8d7a9ab', '72942c8f-ff17-4e3a-afbe-7d488613b1da', '219821a2-8088-4f28-b61f-bc47d1319193', '661442e8-9fcf-4e71-9f46-d53bdd9849de'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.093s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-76a0aadd-60e9-4fe7-b05c-99af63f49384 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-a1885792-d8f0-4b49-8161-5ea2dc0420bd-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-e9d6310f-13d2-464e-ab6c-5930ecfb4a42-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-e9d6310f-13d2-464e-ab6c-5930ecfb4a42-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3f5a1-6961-4ed8-a874-14a5730f0295]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:04 devstack quobyte-client[84528]: System call of process 95005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:04 devstack quobyte-client[84528]: System call of process 95005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:04 devstack quobyte-client[84528]: System call of process 95005 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" returned: 0 in 0.486s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" returned: 0 in 0.107s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-e9d6310f-13d2-464e-ab6c-5930ecfb4a42" released by "delete_volume" :: held 0.783s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['9a8677ff-82c4-402d-bee8-4463259db099', '716061e0-a21c-4ab3-bdd0-cedb818435ad', 'b93831f4-df72-4f20-8a8a-d52cbe58c3fc', 'af1c881e-9d7d-45dd-bc2c-e32ca9e81eca'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.140s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:05 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:06 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f0119e9f-af88-4289-82fe-eb65b5d7958e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-e9d6310f-13d2-464e-ab6c-5930ecfb4a42-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:06 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-475bb6d5-38bf-46b0-876d-3ded5a6b83aa-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:06 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-475bb6d5-38bf-46b0-876d-3ded5a6b83aa-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" acquired by "delete_volume" :: waited 0.033s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:07 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a41e0-aeb4-4651-8f4b-448eaaa5ce8d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:08 devstack quobyte-client[84528]: System call of process 95047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" returned: 0 in 1.137s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" returned: 0 in 0.190s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-475bb6d5-38bf-46b0-876d-3ded5a6b83aa" released by "delete_volume" :: held 1.714s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['976a66d3-ea66-465f-bb0a-22fb61c5e656', '78fc252b-019d-4e25-aed7-16d4ed12705a', '51c5f82b-bb26-489c-a74c-0ab2cd76a349', '88bdd092-bde8-4337-b622-33d47e4c22e1'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.165s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:09 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:10 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6321f452-9fe6-40e6-9b7a-803f8f537768 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-475bb6d5-38bf-46b0-876d-3ded5a6b83aa-delete_volume" released by "delete_volume" :: held 3.720s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-4a5822e7-acd7-4724-a4c7-6bd6245d1da5-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-4a5822e7-acd7-4724-a4c7-6bd6245d1da5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:11 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b5333-e2dc-461b-8484-7f2e13d52dab]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:11 devstack quobyte-client[84528]: System call of process 95083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" returned: 0 in 0.665s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" returned: 0 in 0.198s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-4a5822e7-acd7-4724-a4c7-6bd6245d1da5" released by "delete_volume" :: held 1.382s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['61958c75-660c-43d3-b9cd-623f291b11c3', '0755d58f-df79-4a8f-b023-0f5934699151', '30d1a29f-0937-45bf-aebc-3bd982315e13', '8bc930bd-f5ac-44a7-9f97-848117fef86e'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.197s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-b9aafd60-2a95-4898-bb32-5ab0a18678ff-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-b9aafd60-2a95-4898-bb32-5ab0a18678ff-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f85f447f-3dd9-4976-a79b-2dcb4788a1c4 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-4a5822e7-acd7-4724-a4c7-6bd6245d1da5-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:13 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-b9aafd60-2a95-4898-bb32-5ab0a18678ff" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b9aafd60-2a95-4898-bb32-5ab0a18678ff" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c110a69-0a21-4f37-883b-610911b5fb0c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff" returned: 0 in 0.430s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b9aafd60-2a95-4898-bb32-5ab0a18678ff" returned: 0 in 0.110s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b9aafd60-2a95-4898-bb32-5ab0a18678ff" released by "delete_volume" :: held 0.715s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:14 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['42722eef-c906-4dc3-a237-3406783bd885', '29c879a8-b105-4b9d-9ff7-4047eea73b2e', '00624380-77ba-4eb3-87db-bfee26069dde', 'cc432c39-b9f5-4f75-9057-8bdc0acb7d23'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.316s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:15 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6122616c-f269-4ec6-883e-159b34f60b6c tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-b9aafd60-2a95-4898-bb32-5ab0a18678ff-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" acquired by "delete_snapshot" :: waited 0.040s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleting offline snapshot 85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 of volume b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] snapshot_file for this snap is: volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe03d94-defc-4a99-ad07-a7922662c5e7]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.616s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2db58a3-e47b-48de-b788-dd9f5e784953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ee031e-4485-47eb-9b25-f9bfc8fa46b4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.433s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953" returned: 0 in 0.750s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:18 devstack quobyte-client[84528]: System call of process 95113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.464s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953.85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" returned: 0 in 0.339s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4" released by "_delete_snapshot" :: held 3.042s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" released by "delete_snapshot" :: held 3.095s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:19 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['f2bfe0ab-0afa-49bf-b69e-2e79e3a2b319', 'c35429f5-b54f-4745-9c7a-5f8dc6faa2d0', 'b7bb308d-fdb2-4813-81b8-065d5fa9300c', '4fa4d490-ef05-4f77-b677-e84000058e4f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Delete snapshot completed successfully.
Sep 24 18:02:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3a0fc10d-2fa3-4b1c-ac1f-db9108f8c749 tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-85a2f39f-9e79-4a6b-88a2-4d1f5e3feeb4-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-b2db58a3-e47b-48de-b788-dd9f5e784953-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-b2db58a3-e47b-48de-b788-dd9f5e784953-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:20 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" acquired by "delete_volume" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd840422-2b67-4176-b4c0-06a241848213]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:02:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:21 devstack quobyte-client[84528]: System call of process 95122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953" returned: 0 in 0.606s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b2db58a3-e47b-48de-b788-dd9f5e784953" returned: 0 in 0.138s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-quobyte-b2db58a3-e47b-48de-b788-dd9f5e784953" released by "delete_volume" :: held 0.988s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Created reservations ['6171cc1e-b995-4b76-a001-9c902aba782c', 'f4c1e35c-bc74-46ac-ac71-d09a93a78454', '18af7868-11f8-42bc-a5ea-bccd98178b0a', 'a2441c05-fe44-47b6-91c4-eea333d66bc8'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:02:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:02:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:02:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.099s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:22 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:02:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Deleted volume successfully.
Sep 24 18:02:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cde7ae95-9c1e-4198-b27d-5a64c248776e tempest-CreateVolumesFromSnapshotTest-909698510 None] Lock "cinder-b2db58a3-e47b-48de-b788-dd9f5e784953-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:02:31 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=44,cinder:UPDATE=74,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:02:32 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=59,cinder:DELETE=9,cinder:SELECT=40,cinder:INSERT=18 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:03:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:03:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.099s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:03:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (64b5608f-9259-4a6c-8b0e-df5d966a8102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa312a-8195-41a9-9b7a-a5c0a4ccc06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fa312a-8195-41a9-9b7a-a5c0a4ccc06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1030979790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf95ae-fe1e-4ccb-9de8-e30d54507f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:03:22Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c0ecf9-3210-4ba4-ba2d-638594330249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c0ecf9-3210-4ba4-ba2d-638594330249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72df637-58fc-4073-b056-97de1cdfe339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72df637-58fc-4073-b056-97de1cdfe339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cf95ae-fe1e-4ccb-9de8-e30d54507f61', 'volume_name': 'volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b28390-377e-4bec-a2e5-9e20eada2575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b28390-377e-4bec-a2e5-9e20eada2575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1c8464-eea2-4284-a8ed-1f8f63548835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:22 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Volume 41cf95ae-fe1e-4ccb-9de8-e30d54507f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61', 'volume_size': 1}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1030979790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf95ae-fe1e-4ccb-9de8-e30d54507f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:03:22Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Creating volume 41cf95ae-fe1e-4ccb-9de8-e30d54507f61 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:03:22 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:03:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:22 devstack quobyte-client[84528]: System call of process 95248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:03:23 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=108, name=volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 1073741824" returned: 0 in 0.372s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.537s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1c8464-eea2-4284-a8ed-1f8f63548835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12b43d-aadd-42af-b771-066f2403c998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:03:23 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Volume volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 (41cf95ae-fe1e-4ccb-9de8-e30d54507f61): created successfully
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b12b43d-aadd-42af-b771-066f2403c998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:03:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (64b5608f-9259-4a6c-8b0e-df5d966a8102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:03:23 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0115e5ac-5918-4b39-83bd-dd997bf3e2ac tempest-AttachVolumeNegativeTest-1770565742 None] Created volume successfully.
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb0ad5f-e8eb-44e7-995b-4aeb7c9b0b85]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" returned: 0 in 0.450s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.503s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:03:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b583945-7001-4dda-9471-355c6cf2fa06', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:03:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:03:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4ecb173f-59c3-4e0f-b260-cf5d79de203d req-ac97fc8e-1f91-4832-89e3-5ab9567df398 tempest-AttachVolumeNegativeTest-1770565742 None] attachment_update completed successfully.
Sep 24 18:03:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:03:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.164s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:04:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:05:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:05:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.177s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:05:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:05:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-3585ff32-5f84-465c-a546-fb2180f984f3 req-f4d94165-65a2-4b62-a6ef-c5d1b71be1ee tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:05:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-3585ff32-5f84-465c-a546-fb2180f984f3 req-f4d94165-65a2-4b62-a6ef-c5d1b71be1ee tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:05:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-3585ff32-5f84-465c-a546-fb2180f984f3 req-f4d94165-65a2-4b62-a6ef-c5d1b71be1ee tempest-AttachVolumeNegativeTest-1770565742 None] Terminate volume connection completed successfully.
Sep 24 18:05:38 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-3585ff32-5f84-465c-a546-fb2180f984f3 req-f4d94165-65a2-4b62-a6ef-c5d1b71be1ee tempest-AttachVolumeNegativeTest-1770565742 None] Deleting attachment 9b583945-7001-4dda-9471-355c6cf2fa06. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:05:48 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:05:48 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.173s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:06:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:07:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.098s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:07:21 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (6656bdd2-4535-40b5-b202-92e4a4931bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6492cb-89f5-4030-a4b3-8291f7de23e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6492cb-89f5-4030-a4b3-8291f7de23e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1895483003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a2538-7502-4638-a568-72ef225f5d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:07:21Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a8f055-e118-43b4-bb61-6e035a00430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a8f055-e118-43b4-bb61-6e035a00430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6e03e1-e62e-435e-b6e2-682e2a6749c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d6e03e1-e62e-435e-b6e2-682e2a6749c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b48a2538-7502-4638-a568-72ef225f5d96', 'volume_name': 'volume-b48a2538-7502-4638-a568-72ef225f5d96', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ece8ff2-de66-4c81-86f0-c51c95b97f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ece8ff2-de66-4c81-86f0-c51c95b97f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdb1b26-d640-4de3-88e7-5d5a11bc6a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:21 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Volume b48a2538-7502-4638-a568-72ef225f5d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b48a2538-7502-4638-a568-72ef225f5d96', 'volume_size': 1}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1895483003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b48a2538-7502-4638-a568-72ef225f5d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:07:21Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Creating volume b48a2538-7502-4638-a568-72ef225f5d96 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:07:21 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:21 devstack quobyte-client[84528]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:21 devstack quobyte-client[84528]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:21 devstack quobyte-client[84528]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:21 devstack quobyte-client[84528]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:21 devstack quobyte-client[84528]: System call of process 96293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:21 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=109, name=volume-b48a2538-7502-4638-a568-72ef225f5d96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 1073741824" returned: 0 in 0.435s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96" returned: 0 in 0.130s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] <== create_volume: return (634ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:07:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.646s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bdb1b26-d640-4de3-88e7-5d5a11bc6a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b48a2538-7502-4638-a568-72ef225f5d96', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab6d70-82a2-4bd6-8982-d90c036a032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:07:22 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Volume volume-b48a2538-7502-4638-a568-72ef225f5d96 (b48a2538-7502-4638-a568-72ef225f5d96): created successfully
Sep 24 18:07:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab6d70-82a2-4bd6-8982-d90c036a032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:07:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (6656bdd2-4535-40b5-b202-92e4a4931bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:07:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-606a1c50-aa3b-4f75-b4ad-3d974fa1a4bb tempest-AttachVolumeNegativeTest-1770565742 None] Created volume successfully.
Sep 24 18:07:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:26 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cab3de-9130-410e-8de2-c79c95835c6b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:07:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:27 devstack quobyte-client[84528]: System call of process 96307 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:07:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96" returned: 0 in 0.468s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.526s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-b48a2538-7502-4638-a568-72ef225f5d96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68c8145c-b1f7-4f3f-8b59-dcd7c8d246fc', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:07:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-a6a3efe1-f1e9-4e15-8958-76b27d5d5d2f req-b37182fc-74a6-4f0e-a690-c251802682c2 tempest-AttachVolumeNegativeTest-1770565742 None] attachment_update completed successfully.
Sep 24 18:07:37 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:07:37 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:07:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-af2bcd97-0f4b-4f77-83ee-e64a21993325 req-e0bf8d3a-73bc-48d6-a290-912fa9cda1fe tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-af2bcd97-0f4b-4f77-83ee-e64a21993325 req-e0bf8d3a-73bc-48d6-a290-912fa9cda1fe tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:56 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-af2bcd97-0f4b-4f77-83ee-e64a21993325 req-e0bf8d3a-73bc-48d6-a290-912fa9cda1fe tempest-AttachVolumeNegativeTest-1770565742 None] Terminate volume connection completed successfully.
Sep 24 18:07:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-af2bcd97-0f4b-4f77-83ee-e64a21993325 req-e0bf8d3a-73bc-48d6-a290-912fa9cda1fe tempest-AttachVolumeNegativeTest-1770565742 None] Deleting attachment 68c8145c-b1f7-4f3f-8b59-dcd7c8d246fc. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:08:06 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.186s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:09:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.113s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:09:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (484d870b-c23f-441c-acdb-f0a63bb4547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8399a7ab-1ad5-4c34-bdb4-a56865ab84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8399a7ab-1ad5-4c34-bdb4-a56865ab84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1798553777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37064a3-a2b8-42c4-b457-295ec441cb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:43Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326b743e-e0fe-421b-a3f8-9d3d25d9d9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326b743e-e0fe-421b-a3f8-9d3d25d9d9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47865281-f1b2-44b7-84f4-dc794cc4be8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47865281-f1b2-44b7-84f4-dc794cc4be8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37064a3-a2b8-42c4-b457-295ec441cb9d', 'volume_name': 'volume-f37064a3-a2b8-42c4-b457-295ec441cb9d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a59d1b-6fc2-48ba-a3e9-5d84a4e283d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a59d1b-6fc2-48ba-a3e9-5d84a4e283d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1fc282-2c3a-4247-a311-9b494b8cebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:43 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Volume f37064a3-a2b8-42c4-b457-295ec441cb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37064a3-a2b8-42c4-b457-295ec441cb9d', 'volume_size': 1}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1798553777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37064a3-a2b8-42c4-b457-295ec441cb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c17fc3faa294db9af4cff0aed71dbdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:43Z,use_quota=True,user_id='02e31e347f7847f585f24ff04a970800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Creating volume f37064a3-a2b8-42c4-b457-295ec441cb9d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:09:43 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:09:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:43 devstack quobyte-client[84528]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:43 devstack quobyte-client[84528]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:43 devstack quobyte-client[84528]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:43 devstack quobyte-client[84528]: System call of process 97066 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:43 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=110, name=volume-f37064a3-a2b8-42c4-b457-295ec441cb9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d 1073741824" returned: 0 in 0.408s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d" returned: 0 in 0.208s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1fc282-2c3a-4247-a311-9b494b8cebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37064a3-a2b8-42c4-b457-295ec441cb9d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698dfaf4-07bf-4a4f-8ad5-8c3083751ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:44 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Volume volume-f37064a3-a2b8-42c4-b457-295ec441cb9d (f37064a3-a2b8-42c4-b457-295ec441cb9d): created successfully
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698dfaf4-07bf-4a4f-8ad5-8c3083751ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Flow 'volume_create_manager' (484d870b-c23f-441c-acdb-f0a63bb4547a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:45 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5fa3dafa-bc63-4787-89f5-c06a3904bb26 tempest-AttachVolumeNegativeTest-1770565742 None] Created volume successfully.
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f526e04-4730-4e7a-bd82-9a4e43fab5a1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:49 devstack quobyte-client[84528]: System call of process 97079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d" returned: 0 in 0.424s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.484s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-f37064a3-a2b8-42c4-b457-295ec441cb9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d5957b0-7fb9-4e97-85cb-8f177913d23a', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:09:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-af746255-bdae-43f8-800e-32c702f398ed req-9d8cfe97-1abb-46e0-a7f7-fa273032e0f2 tempest-AttachVolumeNegativeTest-1770565742 None] attachment_update completed successfully.
Sep 24 18:10:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.128s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-af6e5311-cfb0-4a01-8dcb-88c4513e74b9 req-017fd805-06c2-4f81-87dd-602c354a5018 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-af6e5311-cfb0-4a01-8dcb-88c4513e74b9 req-017fd805-06c2-4f81-87dd-602c354a5018 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-af6e5311-cfb0-4a01-8dcb-88c4513e74b9 req-017fd805-06c2-4f81-87dd-602c354a5018 tempest-AttachVolumeNegativeTest-1770565742 None] Terminate volume connection completed successfully.
Sep 24 18:10:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-af6e5311-cfb0-4a01-8dcb-88c4513e74b9 req-017fd805-06c2-4f81-87dd-602c354a5018 tempest-AttachVolumeNegativeTest-1770565742 None] Deleting attachment 2d5957b0-7fb9-4e97-85cb-8f177913d23a. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:10:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:28 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-f37064a3-a2b8-42c4-b457-295ec441cb9d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-f37064a3-a2b8-42c4-b457-295ec441cb9d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-quobyte-f37064a3-a2b8-42c4-b457-295ec441cb9d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-f37064a3-a2b8-42c4-b457-295ec441cb9d" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[67659415-0422-4629-b7d4-84e606fbb0aa]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d" returned: 0 in 0.436s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f37064a3-a2b8-42c4-b457-295ec441cb9d" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-f37064a3-a2b8-42c4-b457-295ec441cb9d" released by "delete_volume" :: held 0.699s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Created reservations ['955dbc95-43c1-45ac-a7a9-ca70057645c0', '2f30d23f-20fe-4141-bbc0-84e909e512a1', '9d9cd84d-c781-423f-93a5-01268fc478d5', '42e72309-e1b2-4f7d-9338-cf41d9421fbe'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Deleted volume successfully.
Sep 24 18:10:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8dbc290f-e400-46f4-b095-818f3199bdb3 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-f37064a3-a2b8-42c4-b457-295ec441cb9d-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-b48a2538-7502-4638-a568-72ef225f5d96-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-b48a2538-7502-4638-a568-72ef225f5d96-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:32 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-quobyte-b48a2538-7502-4638-a568-72ef225f5d96" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-b48a2538-7502-4638-a568-72ef225f5d96" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:32 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5538b-aed4-4e99-a961-cc83537fbe05]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96" returned: 0 in 0.585s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b48a2538-7502-4638-a568-72ef225f5d96" returned: 0 in 0.140s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-b48a2538-7502-4638-a568-72ef225f5d96" released by "delete_volume" :: held 0.906s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Created reservations ['3ee647c3-935d-41f2-87cd-f41f220850c2', '6809cde3-8da4-49a3-a204-b58a298c8452', 'd3048add-5f4d-46b6-8430-2e671bb097b1', '5266d453-a144-4a28-830d-e16eca4a1a92'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.081s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Deleted volume successfully.
Sep 24 18:10:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-4f68eafa-908a-47ed-a2b1-5786513ef687 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-b48a2538-7502-4638-a568-72ef225f5d96-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-41cf95ae-fe1e-4ccb-9de8-e30d54507f61-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-41cf95ae-fe1e-4ccb-9de8-e30d54507f61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "cinder-quobyte-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8cef2a-b47b-4c45-bb31-57c7be4be5ae]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" returned: 0 in 0.421s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-quobyte-41cf95ae-fe1e-4ccb-9de8-e30d54507f61" released by "delete_volume" :: held 0.678s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Created reservations ['baa7a3d7-eb5d-4ffa-a426-9ba7f277edb6', '8cc2f18a-bf5f-42bb-8de0-2a78a9f6e23b', '4082be09-ea06-4e03-b57e-8a612c44971e', '83dafec9-1940-425f-9f8d-631cb982ea7d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.086s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Deleted volume successfully.
Sep 24 18:10:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-af5d8cba-b5f0-4af6-b9cd-839f493852b2 tempest-AttachVolumeNegativeTest-1770565742 None] Lock "cinder-41cf95ae-fe1e-4ccb-9de8-e30d54507f61-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:45 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Flow 'volume_create_manager' (49aeb09f-c69e-47a2-b54b-d08528daae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a56b90-c4a9-4dda-9cf8-7b9378b16279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a56b90-c4a9-4dda-9cf8-7b9378b16279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-814371190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0c18c2-efdb-4fea-afa2-88d61163b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af964b9d13e4123829e878cb1e4eafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:10:46Z,use_quota=True,user_id='d0844b66b89940eaaf4aaa6348ab0808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb4d52-bc86-40a0-8e2e-a6415c86f28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afcb4d52-bc86-40a0-8e2e-a6415c86f28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f7fa90-a397-40ab-a23d-ff01af2faef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f7fa90-a397-40ab-a23d-ff01af2faef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0c18c2-efdb-4fea-afa2-88d61163b12b', 'volume_name': 'volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1fb16b-5142-4a7e-b5d6-64204cc0367a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1fb16b-5142-4a7e-b5d6-64204cc0367a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1904da-a735-4276-9806-6613e87ad52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Volume ee0c18c2-efdb-4fea-afa2-88d61163b12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b', 'volume_size': 1}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-814371190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0c18c2-efdb-4fea-afa2-88d61163b12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af964b9d13e4123829e878cb1e4eafa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:10:46Z,use_quota=True,user_id='d0844b66b89940eaaf4aaa6348ab0808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Creating volume ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:10:46 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:46 devstack quobyte-client[84528]: System call of process 97622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:46 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=111, name=volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b 1073741824" returned: 0 in 0.377s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b" returned: 0 in 0.087s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.542s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1904da-a735-4276-9806-6613e87ad52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aca540-9603-4b41-b880-81bf4d4ca60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:46 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Volume volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b (ee0c18c2-efdb-4fea-afa2-88d61163b12b): created successfully
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aca540-9603-4b41-b880-81bf4d4ca60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:46 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Flow 'volume_create_manager' (49aeb09f-c69e-47a2-b54b-d08528daae15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:10:46 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-801e7cfc-1fd7-4d91-bf8c-4bcf39fdb13a req-7907a541-6985-41a1-a809-976263f0f7b3 tempest-VolumesSnapshotsTestJSON-301800934 None] Created volume successfully.
Sep 24 18:10:48 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Creating offline snapshot 055d8e32-b593-4a40-96b1-4470f2d9df81 of volume ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:10:48 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1224e295-530d-436d-8a26-d9ce3bae8a1f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:49 devstack quobyte-client[84528]: System call of process 97626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b" returned: 0 in 0.414s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:49 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=112, name=volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 1G" returned: 0 in 0.261s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:49 devstack quobyte-client[84528]: System call of process 97632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "qemu-img rebase -u -b volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.149s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.089s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.info" returned: 0 in 0.089s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:10:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.info" returned: 0 in 0.079s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.561s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-914f4c22-918e-4bda-b761-6bee01875238 req-80f29e6e-e575-49b9-ae3e-790c87c2afaf tempest-VolumesSnapshotsTestJSON-301800934 None] Create snapshot completed successfully
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "cinder-055d8e32-b593-4a40-96b1-4470f2d9df81-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-055d8e32-b593-4a40-96b1-4470f2d9df81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "cinder-quobyte-055d8e32-b593-4a40-96b1-4470f2d9df81" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-055d8e32-b593-4a40-96b1-4470f2d9df81" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Deleting offline snapshot 055d8e32-b593-4a40-96b1-4470f2d9df81 of volume ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] snapshot_file for this snap is: volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[28239d89-9847-4708-970e-58a342fa572c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.394s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf3fef6-7975-4194-b9c2-735b68f773ac]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:52 devstack quobyte-client[84528]: System call of process 97642 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b" returned: 0 in 0.416s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:52 devstack quobyte-client[84528]: System call of process 97645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.294s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b.055d8e32-b593-4a40-96b1-4470f2d9df81" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-055d8e32-b593-4a40-96b1-4470f2d9df81" released by "_delete_snapshot" :: held 1.522s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" released by "delete_snapshot" :: held 1.551s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.quota [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Created reservations ['6db64878-7886-4509-9123-3e3cc36e5122', '0e62091b-46d3-4a1a-a92b-8fa51d9a328d', '1f1dd6d3-ea93-4a7f-99d0-b2c5cfdd4884', '1aba4963-bf9d-4578-9356-34530c6c419c'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Delete snapshot completed successfully.
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-43cbb430-a3cc-45d4-a8bb-5b31ea4b6ff9 req-aef3ffa6-46f2-4e50-983a-015263008cfc tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-055d8e32-b593-4a40-96b1-4470f2d9df81-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "cinder-ee0c18c2-efdb-4fea-afa2-88d61163b12b-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-ee0c18c2-efdb-4fea-afa2-88d61163b12b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ed286-e929-47bd-b494-40a2691941b3]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b" returned: 0 in 0.401s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ee0c18c2-efdb-4fea-afa2-88d61163b12b" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-quobyte-ee0c18c2-efdb-4fea-afa2-88d61163b12b" released by "delete_volume" :: held 0.686s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG cinder.quota [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Created reservations ['e84b4488-7ef0-43b4-b392-f069dc8b197f', 'dd695179-4a42-4c72-87cd-4b5e9006ae12', '27c6a758-418e-4ff1-a2fc-c8b15fb72431', 'ecec845d-561c-41ce-86fb-c216eb301788'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.083s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:54 devstack cinder-volume[84502]: DEBUG cinder.manager [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:55 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Deleted volume successfully.
Sep 24 18:10:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-924f1f56-50c5-4d2a-9bd8-0516f56c7151 req-9c1a7a17-9f56-4c57-948a-9401beeca9a7 tempest-VolumesSnapshotsTestJSON-301800934 None] Lock "cinder-ee0c18c2-efdb-4fea-afa2-88d61163b12b-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:59 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (da76544e-a32d-45b5-9d10-f733fa2e8cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8328e-591c-4d0e-91c9-f222404b1410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8328e-591c-4d0e-91c9-f222404b1410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379875439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8de837-cd27-4dae-8ba2-6898c48e6f91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:10:59Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf57c3c-aa09-461b-8d6b-06d6c544fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf57c3c-aa09-461b-8d6b-06d6c544fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8301177-71d6-4898-82ba-45898d5433cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8301177-71d6-4898-82ba-45898d5433cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8de837-cd27-4dae-8ba2-6898c48e6f91', 'volume_name': 'volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d751774-d991-42f7-8ac9-acafd83121e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d751774-d991-42f7-8ac9-acafd83121e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604b09cc-0c38-42ac-9148-bcbd4d45e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:10:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Volume 2e8de837-cd27-4dae-8ba2-6898c48e6f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91', 'volume_size': 1}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-379875439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8de837-cd27-4dae-8ba2-6898c48e6f91,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:10:59Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Creating volume 2e8de837-cd27-4dae-8ba2-6898c48e6f91 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:10:59 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:59 devstack quobyte-client[84528]: System call of process 97661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:59 devstack quobyte-client[84528]: System call of process 97661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:59 devstack quobyte-client[84528]: System call of process 97661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:59 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=114, name=volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 1073741824" returned: 0 in 0.411s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:10:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.585s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604b09cc-0c38-42ac-9148-bcbd4d45e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad259922-c097-4e9a-a8fe-aa727021dcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:00 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Volume volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 (2e8de837-cd27-4dae-8ba2-6898c48e6f91): created successfully
Sep 24 18:11:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad259922-c097-4e9a-a8fe-aa727021dcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (da76544e-a32d-45b5-9d10-f733fa2e8cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0bd87486-ba5d-441a-adcc-80ef0d0d7575 tempest-VolumesTestJSON-1661633013 None] Created volume successfully.
Sep 24 18:11:01 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (0eccaa2d-6fcd-45ae-bce5-640c209ffcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abecee5-dc31-4b17-99a7-9f8060c8bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abecee5-dc31-4b17-99a7-9f8060c8bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99320559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b5c551-92d9-4a96-9b0a-f3a213fd166d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:02Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f392a15d-0da2-4aae-a582-73cef8f21772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f392a15d-0da2-4aae-a582-73cef8f21772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fba6db-c6f7-4fb9-b36e-8df081e6a744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fba6db-c6f7-4fb9-b36e-8df081e6a744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94b5c551-92d9-4a96-9b0a-f3a213fd166d', 'volume_name': 'volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98448087-28d5-4698-b54e-cf2a7e59e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98448087-28d5-4698-b54e-cf2a7e59e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6157f-aed2-4adb-a6e7-123ab6482e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:01 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Volume 94b5c551-92d9-4a96-9b0a-f3a213fd166d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d', 'volume_size': 1}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-99320559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94b5c551-92d9-4a96-9b0a-f3a213fd166d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:02Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Creating volume 94b5c551-92d9-4a96-9b0a-f3a213fd166d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:11:01 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:11:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:01 devstack quobyte-client[84528]: System call of process 97665 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:01 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=115, name=volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d 1073741824" returned: 0 in 0.348s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] <== create_volume: return (514ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6157f-aed2-4adb-a6e7-123ab6482e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf12c18-0a25-47c9-9c0a-1c008f44a7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:02 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Volume volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d (94b5c551-92d9-4a96-9b0a-f3a213fd166d): created successfully
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf12c18-0a25-47c9-9c0a-1c008f44a7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (0eccaa2d-6fcd-45ae-bce5-640c209ffcc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6f29e04e-1b25-48e2-be05-453ba2a20c68 tempest-VolumesTestJSON-1661633013 None] Created volume successfully.
Sep 24 18:11:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (d5f2d10b-bd1e-44fe-b8a4-cb9417153738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a80f2a-dd24-45e8-9423-99b64f69a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a80f2a-dd24-45e8-9423-99b64f69a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489841241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e9c414-005b-4e59-8be1-9c84ec3b4b63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:04Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052cc98e-479b-4d2f-9d43-5bc6ef421de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052cc98e-479b-4d2f-9d43-5bc6ef421de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cc1ca3-bbde-4091-bb1e-5c4d1fb5506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cc1ca3-bbde-4091-bb1e-5c4d1fb5506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e9c414-005b-4e59-8be1-9c84ec3b4b63', 'volume_name': 'volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fd521-f106-4a47-a766-afdc5ee253d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3fd521-f106-4a47-a766-afdc5ee253d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4e1f4-e4fd-461d-9652-c35061afee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:04 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Volume 89e9c414-005b-4e59-8be1-9c84ec3b4b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63', 'volume_size': 1}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489841241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e9c414-005b-4e59-8be1-9c84ec3b4b63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3aceb317f104896a648aad6c542d440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:04Z,use_quota=True,user_id='74f5c23417a44767a76bcd59b3411d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Creating volume 89e9c414-005b-4e59-8be1-9c84ec3b4b63 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:11:04 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:04 devstack quobyte-client[84528]: System call of process 97670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:04 devstack quobyte-client[84528]: System call of process 97670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:04 devstack quobyte-client[84528]: System call of process 97670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:04 devstack quobyte-client[84528]: System call of process 97670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:04 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=116, name=volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 1073741824" returned: 0 in 0.394s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63" returned: 0 in 0.113s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] <== create_volume: return (579ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.589s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4e1f4-e4fd-461d-9652-c35061afee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4680ae-c1cf-4908-bd88-5c169190007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:05 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Volume volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 (89e9c414-005b-4e59-8be1-9c84ec3b4b63): created successfully
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4680ae-c1cf-4908-bd88-5c169190007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Flow 'volume_create_manager' (d5f2d10b-bd1e-44fe-b8a4-cb9417153738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:05 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-da8ebfbe-d215-472d-8b1a-e629070bd8ee tempest-VolumesTestJSON-1661633013 None] Created volume successfully.
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-89e9c414-005b-4e59-8be1-9c84ec3b4b63-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-89e9c414-005b-4e59-8be1-9c84ec3b4b63-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-quobyte-89e9c414-005b-4e59-8be1-9c84ec3b4b63" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-89e9c414-005b-4e59-8be1-9c84ec3b4b63" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3567a4-4d78-4105-98fe-f7f94b2f8cd6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63" returned: 0 in 0.415s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-89e9c414-005b-4e59-8be1-9c84ec3b4b63" returned: 0 in 0.087s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-89e9c414-005b-4e59-8be1-9c84ec3b4b63" released by "delete_volume" :: held 0.672s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Created reservations ['b2b39c3c-a111-4d16-a5cd-aadbc9b72d5b', '64e40edd-0959-4825-baf0-66601ca92b5b', '48607788-f278-4c25-adef-33bd1d916b10', 'f06c86ff-76bd-46a8-bbe1-b08c5cd9b013'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:08 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:08 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Deleted volume successfully.
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-fc48bd87-2d44-43de-b595-387f88307049 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-89e9c414-005b-4e59-8be1-9c84ec3b4b63-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-94b5c551-92d9-4a96-9b0a-f3a213fd166d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-94b5c551-92d9-4a96-9b0a-f3a213fd166d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-quobyte-94b5c551-92d9-4a96-9b0a-f3a213fd166d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-94b5c551-92d9-4a96-9b0a-f3a213fd166d" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abd4c0f-6526-496f-8e42-6d7daf857aa9]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:10 devstack quobyte-client[84528]: System call of process 97679 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d" returned: 0 in 0.426s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-94b5c551-92d9-4a96-9b0a-f3a213fd166d" returned: 0 in 0.093s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-94b5c551-92d9-4a96-9b0a-f3a213fd166d" released by "delete_volume" :: held 0.682s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Created reservations ['649dc38e-5085-4222-aa47-3eaf3771edea', '9750caec-4502-4b43-ae9f-3133caf95514', '2be8025e-2775-4404-a023-feeb0f861c3b', 'a688d803-3eb6-45c5-8c57-8c29bf4bed9c'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.083s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:11 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Deleted volume successfully.
Sep 24 18:11:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-34b923a6-61fc-4107-a668-685a1146d5f3 tempest-VolumesTestJSON-1661633013 None] Lock "cinder-94b5c551-92d9-4a96-9b0a-f3a213fd166d-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-2e8de837-cd27-4dae-8ba2-6898c48e6f91-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "cinder-2e8de837-cd27-4dae-8ba2-6898c48e6f91-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Acquiring lock "cinder-quobyte-2e8de837-cd27-4dae-8ba2-6898c48e6f91" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-2e8de837-cd27-4dae-8ba2-6898c48e6f91" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3330ef-54ec-49dd-8442-373aaf9b2b4a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:12 devstack quobyte-client[84528]: System call of process 97684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91" returned: 0 in 0.429s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2e8de837-cd27-4dae-8ba2-6898c48e6f91" returned: 0 in 0.093s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "cinder-quobyte-2e8de837-cd27-4dae-8ba2-6898c48e6f91" released by "delete_volume" :: held 0.705s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Created reservations ['0a450907-6473-452c-9ce9-675bf52f1c66', 'f9f6842b-eef7-45ee-9fcb-39e7d3dffdc3', '8318a16d-f4d6-41b1-9f70-74b1754b3ed1', '6c40ae95-ca26-48f8-84f4-47c397a708a4'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.087s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Deleted volume successfully.
Sep 24 18:11:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6a44f2db-765c-40f1-8b15-2011b835279b tempest-VolumesTestJSON-1661633013 None] Lock "cinder-2e8de837-cd27-4dae-8ba2-6898c48e6f91-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.122s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d7409f64-a597-47b7-82e5-67b0e38df644 tempest-BackendsCapabilitiesAdminTestsJSON-1492572454 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.915470123291, 'free_capacity_gb': 924.915470123291, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84502) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 24 18:11:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2bff2e99-9097-418d-8e7e-f6c872fde69f tempest-BackendsCapabilitiesAdminTestsJSON-1492572454 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.915470123291, 'free_capacity_gb': 924.915470123291, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84502) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 24 18:11:23 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=63,cinder:SELECT=47,cinder:INSERT=15,cinder:DELETE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:23 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=44,cinder:INSERT=17,cinder:UPDATE=79,cinder:DELETE=8 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:24 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-39dbee4c-86c3-4707-80ea-69a1d76debaf tempest-GroupSnapshotsV319Test-1038516182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:24 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-39dbee4c-86c3-4707-80ea-69a1d76debaf tempest-GroupSnapshotsV319Test-1038516182 None] Group tempest-GroupSnapshotsV319Test-Group-1260278627: creating
Sep 24 18:11:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-39dbee4c-86c3-4707-80ea-69a1d76debaf tempest-GroupSnapshotsV319Test-1038516182 None] Group tempest-GroupSnapshotsV319Test-Group-1260278627: created successfully
Sep 24 18:11:25 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-39dbee4c-86c3-4707-80ea-69a1d76debaf tempest-GroupSnapshotsV319Test-1038516182 None] Create group completed successfully.
Sep 24 18:11:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Flow 'volume_create_manager' (a047b93a-834f-43a2-8e64-b9f02e3f511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf5850f-b470-4229-b070-356d4778dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf5850f-b470-4229-b070-356d4778dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23255092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4798effc-9935-4a84-aeee-ece93e0cfdad,host='devstack@QuobyteHD#QuobyteHD',id=3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71c9378ce1148d4aec3b219b4d3d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:26Z,use_quota=True,user_id='e90df62cabd24a18bc81e2bd76928e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa6ccda1-af4a-447d-a8b3-2d2c213c2cae),volume_type_id=aa6ccda1-af4a-447d-a8b3-2d2c213c2cae)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b100380c-e54e-4ce5-a6e9-420be9b94968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b100380c-e54e-4ce5-a6e9-420be9b94968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e2037-debf-47b2-a0f9-4d5d538acc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b60e2037-debf-47b2-a0f9-4d5d538acc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e', 'volume_name': 'volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea1c548-0272-4790-9d96-e8e314602056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea1c548-0272-4790-9d96-e8e314602056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bb5cc0-db46-4844-874d-277b99ce2134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Volume 3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e', 'volume_size': 1}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4798effc-9935-4a84-aeee-ece93e0cfdad,created_at=2025-09-24T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-23255092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4798effc-9935-4a84-aeee-ece93e0cfdad,host='devstack@QuobyteHD#QuobyteHD',id=3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71c9378ce1148d4aec3b219b4d3d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:26Z,use_quota=True,user_id='e90df62cabd24a18bc81e2bd76928e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aa6ccda1-af4a-447d-a8b3-2d2c213c2cae),volume_type_id=aa6ccda1-af4a-447d-a8b3-2d2c213c2cae)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Creating volume 3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:11:26 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:11:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:26 devstack quobyte-client[84528]: System call of process 97696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:26 devstack quobyte-client[84528]: System call of process 97696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:26 devstack quobyte-client[84528]: System call of process 97696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:26 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=117, name=volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e 1073741824" returned: 0 in 0.427s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.623s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86bb5cc0-db46-4844-874d-277b99ce2134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3caac7-06e7-4333-8e9e-b9f81dbea64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Volume volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e (3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e): created successfully
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3caac7-06e7-4333-8e9e-b9f81dbea64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Flow 'volume_create_manager' (a047b93a-834f-43a2-8e64-b9f02e3f511b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2a6a0938-23d4-4598-a77a-e31c482d6e35 tempest-GroupSnapshotsV319Test-1038516182 None] Created volume successfully.
Sep 24 18:11:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] GroupSnapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: creating.
Sep 24 18:11:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Group snapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: creating. {{(pid=84502) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Creating offline snapshot bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec of volume 3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[967a5974-5870-48fa-a2a6-8a9d86a62474]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" returned: 0 in 0.444s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:29 devstack quobyte-client[84528]: System call of process 97703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:29 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=118, name=volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec 1G" returned: 0 in 0.269s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:30 devstack quobyte-client[84528]: System call of process 97706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "qemu-img rebase -u -b volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.163s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.097s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.info" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.info" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.601s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-07387f7c-6470-4628-a87f-cea30f3e2f5f tempest-GroupSnapshotsV319Test-1038516182 None] group_snapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: created successfully
Sep 24 18:11:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] group_snapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: deleting
Sep 24 18:11:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] group_snapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: deleting {{(pid=84502) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "cinder-quobyte-bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Deleting offline snapshot bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec of volume 3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] snapshot_file for this snap is: volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4698d3-027d-453b-9fbb-a39afc4bd83d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.396s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7008878-7d6d-4018-a1ef-f9ff3d684415]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:32 devstack quobyte-client[84528]: System call of process 97717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" returned: 0 in 0.388s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:33 devstack quobyte-client[84528]: System call of process 97721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.253s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e.bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" returned: 0 in 0.084s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-bcc4ea74-3654-4ab5-8af3-ee0b01faf1ec" released by "_delete_snapshot" :: held 1.468s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" released by "delete_snapshot" :: held 1.506s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:33 devstack cinder-volume[84502]: WARNING cinder.quota [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1874345311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1874345311, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:11:33 devstack cinder-volume[84502]: WARNING cinder.quota [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1874345311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1874345311, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:11:33 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] Created reservations ['1641f381-c725-4e28-b300-8f52f0da77de', 'afdfc953-2888-43f2-9b86-ebae6278d9a5', '66c1c828-1b67-4bb6-8a94-af1d60684b10', '8bed83b3-8154-445f-8dd8-abb5ab5bcad7'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d52a72fc-841b-4f3e-9a5f-bd05ab6958a7 tempest-GroupSnapshotsV319Test-1038516182 None] group_snapshot 61802aa7-4a76-4b40-a322-d6e29d1356fb: deleted successfully
Sep 24 18:11:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" acquired by "delete_volume" :: waited 0.033s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:34 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e2d6c5-83a6-4550-9858-b57c7f211f69]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:35 devstack quobyte-client[84528]: System call of process 97755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" returned: 0 in 0.443s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" returned: 0 in 0.111s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Lock "cinder-quobyte-3a8f5fea-5a0c-4ea9-9a76-7306cc1bcb2e" released by "delete_volume" :: held 0.738s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Created reservations ['5da9f9c1-918f-4998-8089-10787f98085f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:35 devstack cinder-volume[84502]: WARNING cinder.quota [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1874345311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1874345311, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Created reservations ['3f0fffe7-8c83-439e-bdb2-e67ce5fa9ba0', '32914411-282d-48e1-b67c-9c73bcc76c0a', '464c3133-a5f4-4ac5-8568-3817462181b6', '82611fa3-495b-4691-83ec-72232df28b1a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.083s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:36 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b34e8147-7791-4cb3-bbc1-46e1b315030b tempest-GroupSnapshotsV319Test-1038516182 None] Delete group completed successfully.
Sep 24 18:11:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-cbda6d26-66bc-40cd-b7b5-7236e26cac8e tempest-GroupsV320Test-199227447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cbda6d26-66bc-40cd-b7b5-7236e26cac8e tempest-GroupsV320Test-199227447 None] Group tempest-GroupsV320Test-Group-1285630983: creating
Sep 24 18:11:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cbda6d26-66bc-40cd-b7b5-7236e26cac8e tempest-GroupsV320Test-199227447 None] Group tempest-GroupsV320Test-Group-1285630983: created successfully
Sep 24 18:11:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cbda6d26-66bc-40cd-b7b5-7236e26cac8e tempest-GroupsV320Test-199227447 None] Create group completed successfully.
Sep 24 18:11:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Created reservations ['57d647a1-2557-49cf-b0b1-5b293ce87bf6'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.120s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:44 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c2a587d3-0cd8-46dc-a5a1-8a54e599dbd4 tempest-GroupsV320Test-199227447 None] Delete group completed successfully.
Sep 24 18:11:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Flow 'volume_create_manager' (3178abf5-f546-4518-8477-090e62045259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8143803b-d104-4c4d-8c01-216592ac7522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8143803b-d104-4c4d-8c01-216592ac7522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1615136601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd4e760-2c25-419c-8c4f-b1004c9bd661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ad899c368b401f8cc46a7bab5daf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:50Z,use_quota=True,user_id='3ac059d54cb14bc0bf91ab18adef0f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2772841-ba8b-4260-b91b-0f757476b725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2772841-ba8b-4260-b91b-0f757476b725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc099a6-8055-4c0a-b629-d9fa5f47d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc099a6-8055-4c0a-b629-d9fa5f47d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd4e760-2c25-419c-8c4f-b1004c9bd661', 'volume_name': 'volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c199eac-1ae9-44f6-9083-e84669945df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c199eac-1ae9-44f6-9083-e84669945df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90561b3f-9797-4b5e-b673-7bee0c71a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:50 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume 9cd4e760-2c25-419c-8c4f-b1004c9bd661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661', 'volume_size': 1}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1615136601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd4e760-2c25-419c-8c4f-b1004c9bd661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ad899c368b401f8cc46a7bab5daf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:11:50Z,use_quota=True,user_id='3ac059d54cb14bc0bf91ab18adef0f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Creating volume 9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:11:50 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:50 devstack quobyte-client[84528]: System call of process 97765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:50 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=120, name=volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 1073741824" returned: 0 in 0.359s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661" returned: 0 in 0.086s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] <== create_volume: return (535ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90561b3f-9797-4b5e-b673-7bee0c71a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b9785b-2f8e-4a2d-a4c0-50d1bdd73f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:11:51 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 (9cd4e760-2c25-419c-8c4f-b1004c9bd661): created successfully
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b9785b-2f8e-4a2d-a4c0-50d1bdd73f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:11:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Flow 'volume_create_manager' (3178abf5-f546-4518-8477-090e62045259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:11:51 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b2b0ef75-1660-46c9-8cd8-37afbce97e97 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Created volume successfully.
Sep 24 18:11:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Creating offline snapshot 105d373e-305f-4929-84d5-dc6a034ffab7 of volume 9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:11:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e7dd1-41d2-4f1d-bc2f-4580146570ed]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661" returned: 0 in 0.461s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:53 devstack quobyte-client[84528]: System call of process 97773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:53 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=121, name=volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 1G" returned: 0 in 0.301s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "qemu-img rebase -u -b volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.156s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.122s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:11:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.098s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.info" returned: 0 in 0.098s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.info" returned: 0 in 0.092s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.707s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:54 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f0d31db7-78bb-4c6d-830b-b51b5b3e4f90 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Create snapshot completed successfully
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "cinder-105d373e-305f-4929-84d5-dc6a034ffab7-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-105d373e-305f-4929-84d5-dc6a034ffab7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "cinder-quobyte-105d373e-305f-4929-84d5-dc6a034ffab7" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-105d373e-305f-4929-84d5-dc6a034ffab7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Deleting offline snapshot 105d373e-305f-4929-84d5-dc6a034ffab7 of volume 9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] snapshot_file for this snap is: volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb06f4e-a02a-4003-a993-9c6aa206a590]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.404s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d4832-d41e-4841-a207-24db081056f2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:57 devstack quobyte-client[84528]: System call of process 97786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661" returned: 0 in 0.427s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:57 devstack quobyte-client[84528]: System call of process 97789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.225s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661.105d373e-305f-4929-84d5-dc6a034ffab7" returned: 0 in 0.095s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-105d373e-305f-4929-84d5-dc6a034ffab7" released by "_delete_snapshot" :: held 1.483s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" released by "delete_snapshot" :: held 1.528s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Created reservations ['fa6a57d9-41c3-404b-9671-066f3075dd4c', '271bc3c9-9785-4c1f-9b12-34f2e7d0fd7e', 'cad7b575-1e92-4edf-a967-e0838394b454', 'a7cd3fa1-25bf-431f-a207-ed17a85df191'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Delete snapshot completed successfully.
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-01570e89-2c5e-4883-823e-8529132fe5c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-105d373e-305f-4929-84d5-dc6a034ffab7-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "cinder-9cd4e760-2c25-419c-8c4f-b1004c9bd661-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-9cd4e760-2c25-419c-8c4f-b1004c9bd661-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b1b81a-fb05-453e-b99b-037eda6ac5b3]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661" returned: 0 in 0.408s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9cd4e760-2c25-419c-8c4f-b1004c9bd661" returned: 0 in 0.099s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-quobyte-9cd4e760-2c25-419c-8c4f-b1004c9bd661" released by "delete_volume" :: held 0.741s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:59 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Created reservations ['44b2b382-811a-4a97-8140-0058f56a54a1', '102f2ec3-5004-48ea-9f79-18ce9846a34a', '574c9bac-0300-4b10-9426-0cfefa8d4c82', 'b7312073-dc3d-408b-8fbb-4a2ba3dde7ac'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Deleted volume successfully.
Sep 24 18:12:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f6d2ca0d-7d39-4062-9faf-3a091a5233a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-405480194 None] Lock "cinder-9cd4e760-2c25-419c-8c4f-b1004c9bd661-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:06 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Flow 'volume_create_manager' (904331f8-b64a-4e1b-88e9-e8ebbcaa8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c56ff1-df26-47c4-8397-572a6a90c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c56ff1-df26-47c4-8397-572a6a90c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1307900840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6489d5d6-c06a-487e-8232-8f0ec0354812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb62a0dd702b44ea8047cc79bd6fead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:07Z,use_quota=True,user_id='a958617fe5034bffa9c8fd60779b493d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9908517a-4aa1-48b4-bdc3-29844b8571d6),volume_type_id=9908517a-4aa1-48b4-bdc3-29844b8571d6)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16246c0-3c21-442a-a4d7-1f575c483f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16246c0-3c21-442a-a4d7-1f575c483f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d756178-48a2-4ae4-90a7-ac782b77a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d756178-48a2-4ae4-90a7-ac782b77a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6489d5d6-c06a-487e-8232-8f0ec0354812', 'volume_name': 'volume-6489d5d6-c06a-487e-8232-8f0ec0354812', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c79e9e8-bc17-4f9d-a49f-d8c558aa0246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c79e9e8-bc17-4f9d-a49f-d8c558aa0246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983c56cd-b73c-459c-959f-4b490bbc69ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:06 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Volume 6489d5d6-c06a-487e-8232-8f0ec0354812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6489d5d6-c06a-487e-8232-8f0ec0354812', 'volume_size': 1}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1307900840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6489d5d6-c06a-487e-8232-8f0ec0354812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb62a0dd702b44ea8047cc79bd6fead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:07Z,use_quota=True,user_id='a958617fe5034bffa9c8fd60779b493d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9908517a-4aa1-48b4-bdc3-29844b8571d6),volume_type_id=9908517a-4aa1-48b4-bdc3-29844b8571d6)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Creating volume 6489d5d6-c06a-487e-8232-8f0ec0354812 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:12:06 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:12:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:07 devstack quobyte-client[84528]: System call of process 97805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:07 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=123, name=volume-6489d5d6-c06a-487e-8232-8f0ec0354812, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812 1073741824" returned: 0 in 0.411s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812" returned: 0 in 0.089s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983c56cd-b73c-459c-959f-4b490bbc69ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6489d5d6-c06a-487e-8232-8f0ec0354812', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236e6cb7-2565-420a-a098-a41ce99a4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:07 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Volume volume-6489d5d6-c06a-487e-8232-8f0ec0354812 (6489d5d6-c06a-487e-8232-8f0ec0354812): created successfully
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236e6cb7-2565-420a-a098-a41ce99a4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Flow 'volume_create_manager' (904331f8-b64a-4e1b-88e9-e8ebbcaa8285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7965b3a4-c4b3-4fc3-8128-4ad2861664cd tempest-VolumeTypesAccessTest-1807951470 None] Created volume successfully.
Sep 24 18:12:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Acquiring lock "cinder-6489d5d6-c06a-487e-8232-8f0ec0354812-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:08 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "cinder-6489d5d6-c06a-487e-8232-8f0ec0354812-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Acquiring lock "cinder-quobyte-6489d5d6-c06a-487e-8232-8f0ec0354812" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "cinder-quobyte-6489d5d6-c06a-487e-8232-8f0ec0354812" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c776a22-d242-4ba3-8eff-0d680ab61cd6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812" returned: 0 in 0.403s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-6489d5d6-c06a-487e-8232-8f0ec0354812" returned: 0 in 0.101s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:09 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "cinder-quobyte-6489d5d6-c06a-487e-8232-8f0ec0354812" released by "delete_volume" :: held 0.679s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:09 devstack cinder-volume[84502]: WARNING cinder.quota [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1268003972 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1268003972, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:12:09 devstack cinder-volume[84502]: WARNING cinder.quota [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1268003972 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1268003972, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Created reservations ['9ee4436f-9688-43dc-b375-43565b29a505', '8896642e-18b9-4fd9-a938-c48370f92790', '04005af6-7a3e-4e31-929e-07e8a8899c13', 'e63356b3-8063-4ca2-8180-4ee67127d721'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:10 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Deleted volume successfully.
Sep 24 18:12:10 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8809211a-2664-4842-81c2-63e63eb3b4f4 tempest-VolumeTypesAccessTest-1807951470 None] Lock "cinder-6489d5d6-c06a-487e-8232-8f0ec0354812-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:20 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=50,cinder:UPDATE=45,cinder:DELETE=3,cinder:INSERT=12 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:20 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=58,cinder:SELECT=46,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Flow 'volume_create_manager' (a77306be-655e-4a92-a418-71e8cf1c55f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f94d5-b7d6-434b-9a5c-3e2a627db299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3f94d5-b7d6-434b-9a5c-3e2a627db299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1700388475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ba1587-5297-4fb4-a04e-5cfed2990b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a1016d5937b492581b702e866f6b1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:24Z,use_quota=True,user_id='9abd7d9886f847efb2a96d76a811fff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b6e1e3-54ba-4e4e-b49f-0cdd910f460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0b6e1e3-54ba-4e4e-b49f-0cdd910f460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c6f172-ce48-4763-8ab6-e3e258560427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c6f172-ce48-4763-8ab6-e3e258560427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ba1587-5297-4fb4-a04e-5cfed2990b73', 'volume_name': 'volume-91ba1587-5297-4fb4-a04e-5cfed2990b73', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40165f2-1f67-4be4-90c9-3428c13a7b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40165f2-1f67-4be4-90c9-3428c13a7b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf1f9d2-dd92-4515-96fb-d718359fe1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:23 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Volume 91ba1587-5297-4fb4-a04e-5cfed2990b73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ba1587-5297-4fb4-a04e-5cfed2990b73', 'volume_size': 1}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1700388475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ba1587-5297-4fb4-a04e-5cfed2990b73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a1016d5937b492581b702e866f6b1ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:24Z,use_quota=True,user_id='9abd7d9886f847efb2a96d76a811fff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Creating volume 91ba1587-5297-4fb4-a04e-5cfed2990b73 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:12:23 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:12:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:24 devstack quobyte-client[84528]: System call of process 97819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:24 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=124, name=volume-91ba1587-5297-4fb4-a04e-5cfed2990b73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 1073741824" returned: 0 in 0.393s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.564s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf1f9d2-dd92-4515-96fb-d718359fe1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ba1587-5297-4fb4-a04e-5cfed2990b73', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a9ddef-44af-4087-8314-a51f57b39999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:24 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Volume volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 (91ba1587-5297-4fb4-a04e-5cfed2990b73): created successfully
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a9ddef-44af-4087-8314-a51f57b39999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:24 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Flow 'volume_create_manager' (a77306be-655e-4a92-a418-71e8cf1c55f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:24 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-556e56d7-e724-43b9-bbe2-2d7e43258eb1 tempest-VolumesMetadataTest-791750030 None] Created volume successfully.
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Acquiring lock "cinder-91ba1587-5297-4fb4-a04e-5cfed2990b73-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "cinder-91ba1587-5297-4fb4-a04e-5cfed2990b73-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Acquiring lock "cinder-quobyte-91ba1587-5297-4fb4-a04e-5cfed2990b73" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "cinder-quobyte-91ba1587-5297-4fb4-a04e-5cfed2990b73" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbcc262-e3a8-454a-9583-10f49e5d1039]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73" returned: 0 in 0.413s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-91ba1587-5297-4fb4-a04e-5cfed2990b73" returned: 0 in 0.116s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "cinder-quobyte-91ba1587-5297-4fb4-a04e-5cfed2990b73" released by "delete_volume" :: held 0.702s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:27 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Created reservations ['0cbdaf04-caef-47a2-a7ee-7097b58a9ee9', '1c35c5a6-af00-4398-8d5e-e96ebaa562fe', 'a13447a7-3bc7-4553-bd1e-867a797b3cbe', '4b6d990d-edec-4792-bda2-90ff16e9d915'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Deleted volume successfully.
Sep 24 18:12:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48d9bd52-6f5f-4906-b7a3-c809cadbc048 tempest-VolumesMetadataTest-791750030 None] Lock "cinder-91ba1587-5297-4fb4-a04e-5cfed2990b73-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Flow 'volume_create_manager' (3a21a829-524d-4ed0-b99d-bb0bc181c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f5c90f-b982-4e01-a6f4-64b5a2abf14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f5c90f-b982-4e01-a6f4-64b5a2abf14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-461220445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da460b57-cee6-4088-9ca5-1026068b7f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488a748cb0f940a387a8659277d8605a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:33Z,use_quota=True,user_id='ad68563f9f5f4c7e8a73eff8f5dea1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252a6412-1c32-4140-b8a3-cca1ac591846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252a6412-1c32-4140-b8a3-cca1ac591846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bd116e-ed0e-4724-93eb-0674079534d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bd116e-ed0e-4724-93eb-0674079534d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da460b57-cee6-4088-9ca5-1026068b7f10', 'volume_name': 'volume-da460b57-cee6-4088-9ca5-1026068b7f10', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dbe2a9-9e3f-4d9d-804e-08ef946b6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77dbe2a9-9e3f-4d9d-804e-08ef946b6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53bacca-2056-43f5-b442-2bc89a7a77a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:33 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Volume da460b57-cee6-4088-9ca5-1026068b7f10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da460b57-cee6-4088-9ca5-1026068b7f10', 'volume_size': 1}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-461220445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da460b57-cee6-4088-9ca5-1026068b7f10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488a748cb0f940a387a8659277d8605a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:33Z,use_quota=True,user_id='ad68563f9f5f4c7e8a73eff8f5dea1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Creating volume da460b57-cee6-4088-9ca5-1026068b7f10 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:12:33 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:33 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=125, name=volume-da460b57-cee6-4088-9ca5-1026068b7f10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10 1073741824" returned: 0 in 0.353s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] <== create_volume: return (509ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:12:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.520s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b53bacca-2056-43f5-b442-2bc89a7a77a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da460b57-cee6-4088-9ca5-1026068b7f10', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e12a2d-a26c-4f0c-b851-933f5d799810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:34 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Volume volume-da460b57-cee6-4088-9ca5-1026068b7f10 (da460b57-cee6-4088-9ca5-1026068b7f10): created successfully
Sep 24 18:12:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e12a2d-a26c-4f0c-b851-933f5d799810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Flow 'volume_create_manager' (3a21a829-524d-4ed0-b99d-bb0bc181c430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e0651e9f-58ad-46db-8ba6-51d2a4dee173 tempest-VolumesTransfersV355Test-1298422650 None] Created volume successfully.
Sep 24 18:12:35 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4389a45b-b62f-4338-8269-18bd7de735bf tempest-VolumesTransfersV355Test-193266698 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:35 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4389a45b-b62f-4338-8269-18bd7de735bf tempest-VolumesTransfersV355Test-193266698 None] Transfer volume completed successfully.
Sep 24 18:12:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "cinder-da460b57-cee6-4088-9ca5-1026068b7f10-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-da460b57-cee6-4088-9ca5-1026068b7f10-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:37 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "cinder-quobyte-da460b57-cee6-4088-9ca5-1026068b7f10" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-quobyte-da460b57-cee6-4088-9ca5-1026068b7f10" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7df39d3-acb8-46e0-82a3-44104dced1f6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:37 devstack quobyte-client[84528]: System call of process 97865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10" returned: 0 in 0.445s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-da460b57-cee6-4088-9ca5-1026068b7f10" returned: 0 in 0.115s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-quobyte-da460b57-cee6-4088-9ca5-1026068b7f10" released by "delete_volume" :: held 0.716s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Created reservations ['02b458a7-1786-46da-8f86-2f73bc4971a6', 'c26af317-8804-4f08-ab62-403621e76490', '1d68d18d-0a66-4acb-9b08-e9ffe91e6f58', '465e7ba3-b800-4b3e-a8b6-2a81f1337234'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Deleted volume successfully.
Sep 24 18:12:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dc912e10-bcd7-43ef-b8e0-7c2a553f6f1d tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-da460b57-cee6-4088-9ca5-1026068b7f10-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Flow 'volume_create_manager' (3eea07a7-0e21-4545-94d2-1d8d19584c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f14b703-a92b-4a42-bf99-f97777f9e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f14b703-a92b-4a42-bf99-f97777f9e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2047298626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab99b24-6a49-4db1-8b7c-904df5970269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488a748cb0f940a387a8659277d8605a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:40Z,use_quota=True,user_id='ad68563f9f5f4c7e8a73eff8f5dea1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52d1688-7186-4d60-be35-ff8b69a498aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c52d1688-7186-4d60-be35-ff8b69a498aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee247c-2516-4118-bcdb-c20d04520061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ee247c-2516-4118-bcdb-c20d04520061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab99b24-6a49-4db1-8b7c-904df5970269', 'volume_name': 'volume-dab99b24-6a49-4db1-8b7c-904df5970269', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0197048-a5ae-4cdf-851a-ccd4f676f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0197048-a5ae-4cdf-851a-ccd4f676f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c011a21-3301-4e6e-bcfe-a6bd8603b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:39 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Volume dab99b24-6a49-4db1-8b7c-904df5970269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab99b24-6a49-4db1-8b7c-904df5970269', 'volume_size': 1}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2047298626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab99b24-6a49-4db1-8b7c-904df5970269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='488a748cb0f940a387a8659277d8605a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:40Z,use_quota=True,user_id='ad68563f9f5f4c7e8a73eff8f5dea1b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Creating volume dab99b24-6a49-4db1-8b7c-904df5970269 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:12:39 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:40 devstack quobyte-client[84528]: System call of process 97870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:40 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=126, name=volume-dab99b24-6a49-4db1-8b7c-904df5970269, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269 1073741824" returned: 0 in 0.354s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.528s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c011a21-3301-4e6e-bcfe-a6bd8603b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab99b24-6a49-4db1-8b7c-904df5970269', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d27b213-811b-415f-8f2b-2bd08c5e647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:40 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Volume volume-dab99b24-6a49-4db1-8b7c-904df5970269 (dab99b24-6a49-4db1-8b7c-904df5970269): created successfully
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d27b213-811b-415f-8f2b-2bd08c5e647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Flow 'volume_create_manager' (3eea07a7-0e21-4545-94d2-1d8d19584c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3549b918-c6b3-455b-84da-e2bcb8fdb465 tempest-VolumesTransfersV355Test-1298422650 None] Created volume successfully.
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "cinder-dab99b24-6a49-4db1-8b7c-904df5970269-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-dab99b24-6a49-4db1-8b7c-904df5970269-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:42 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "cinder-quobyte-dab99b24-6a49-4db1-8b7c-904df5970269" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-quobyte-dab99b24-6a49-4db1-8b7c-904df5970269" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca103d1d-5bb0-484a-82ed-ba68dc9f579f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269" returned: 0 in 0.426s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-dab99b24-6a49-4db1-8b7c-904df5970269" returned: 0 in 0.116s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-quobyte-dab99b24-6a49-4db1-8b7c-904df5970269" released by "delete_volume" :: held 0.696s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Created reservations ['1f1f3ef4-6afb-4729-8bc6-b2aa8b1097d3', 'b007dda9-69dd-442f-9bc1-b1d212a61f93', 'd88b2be8-74a3-4cbe-819a-6668e625d49f', '12e830c9-2d4e-4e8e-b56e-8ef3855886bb'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.107s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Deleted volume successfully.
Sep 24 18:12:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-68f758c1-361d-42da-b663-e6ffc5936916 tempest-VolumesTransfersV355Test-106444914 None] Lock "cinder-dab99b24-6a49-4db1-8b7c-904df5970269-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=36,cinder:SELECT=15,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Flow 'volume_create_manager' (9e11e406-334b-40a6-935b-5f49bf617494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ee2dbf-9f80-4ad6-b26f-5ab16d01e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ee2dbf-9f80-4ad6-b26f-5ab16d01e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1454475150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7354da0c-65f9-4810-a47a-c20d56ac4583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a171529b3c854874a6452bda22e8b410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:13:03Z,use_quota=True,user_id='333bf101896d42bba490d71bce8a3b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31c7c81-7c34-4ef3-b961-5a778ba4e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31c7c81-7c34-4ef3-b961-5a778ba4e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a749567-47b8-45cb-8ee0-3995a8718a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a749567-47b8-45cb-8ee0-3995a8718a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7354da0c-65f9-4810-a47a-c20d56ac4583', 'volume_name': 'volume-7354da0c-65f9-4810-a47a-c20d56ac4583', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e4cbff-c905-4b3b-89d2-8e262a8bae09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e4cbff-c905-4b3b-89d2-8e262a8bae09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f363389-14fc-4ea0-9c3c-c0691858ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:02 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Volume 7354da0c-65f9-4810-a47a-c20d56ac4583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7354da0c-65f9-4810-a47a-c20d56ac4583', 'volume_size': 1}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1454475150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7354da0c-65f9-4810-a47a-c20d56ac4583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a171529b3c854874a6452bda22e8b410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:13:03Z,use_quota=True,user_id='333bf101896d42bba490d71bce8a3b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Creating volume 7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:13:02 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:13:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:03 devstack quobyte-client[84528]: System call of process 97888 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:03 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=127, name=volume-7354da0c-65f9-4810-a47a-c20d56ac4583, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 1073741824" returned: 0 in 0.350s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] <== create_volume: return (497ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f363389-14fc-4ea0-9c3c-c0691858ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7354da0c-65f9-4810-a47a-c20d56ac4583', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e862fed6-306b-42e0-893a-b3c49c6da9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:13:03 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Volume volume-7354da0c-65f9-4810-a47a-c20d56ac4583 (7354da0c-65f9-4810-a47a-c20d56ac4583): created successfully
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e862fed6-306b-42e0-893a-b3c49c6da9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:13:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Flow 'volume_create_manager' (9e11e406-334b-40a6-935b-5f49bf617494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:13:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7d236bbc-32b1-4a21-8986-8d0095413281 tempest-VolumesActionsTest-1508949558 None] Created volume successfully.
Sep 24 18:13:13 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:13 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.128s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:13:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" by "attach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" acquired by "attach_volume" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Attaching volume 7354da0c-65f9-4810-a47a-c20d56ac4583 to instance a2b335fe-b565-4aea-b8aa-b2bfe28b3387 at mountpoint /dev/vdb on host None.
Sep 24 18:13:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Attach volume completed successfully.
Sep 24 18:13:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-51409d2b-710b-416a-a5d3-dd72526ed0dd tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" released by "attach_volume" :: held 0.378s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" by "detach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Detaching volume 7354da0c-65f9-4810-a47a-c20d56ac4583 from instance a2b335fe-b565-4aea-b8aa-b2bfe28b3387.
Sep 24 18:13:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Detach volume completed successfully.
Sep 24 18:13:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-1ccc03cf-a3ab-4750-830b-39ccfd8495bf tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:41 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:41 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" by "attach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:14:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" acquired by "attach_volume" :: waited 0.030s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:14:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:14:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Attaching volume 7354da0c-65f9-4810-a47a-c20d56ac4583 to instance 81b2e2ed-961a-42fd-bded-3cafc4d458d4 at mountpoint /dev/vdb on host None.
Sep 24 18:14:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Attach volume completed successfully.
Sep 24 18:14:02 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5598dc4a-f8ac-4e86-b6a9-1734d51bbffa tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583" released by "attach_volume" :: held 0.276s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:14:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" by "detach_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:14:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:14:03 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:14:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Detaching volume 7354da0c-65f9-4810-a47a-c20d56ac4583 from instance 81b2e2ed-961a-42fd-bded-3cafc4d458d4.
Sep 24 18:14:03 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:14:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Detach volume completed successfully.
Sep 24 18:14:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3d6cd0e8-24a1-4707-9b5b-97a364845992 tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-detach_volume" released by "detach_volume" :: held 0.283s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:13 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[5095129f-97e4-48ed-a202-182154375634]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:14 devstack quobyte-client[84528]: System call of process 98227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:14 devstack quobyte-client[84528]: System call of process 98227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:14 devstack quobyte-client[84528]: System call of process 98227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.448s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:14 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[885eced0-3e61-465b-8795-417fc7b966cf]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:14 devstack quobyte-client[84528]: System call of process 98230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:14 devstack quobyte-client[84528]: System call of process 98230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.484s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.45b470c0-c1e1-4615-91e3-d495f71ba3be1yd9kl9s.img {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:15 devstack quobyte-client[84528]: System call of process 98233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.283s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:14:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.45b470c0-c1e1-4615-91e3-d495f71ba3be1yd9kl9s.img" returned: 0 in 6.448s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:21 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e518ad9d-173f-4403-89a4-7f019d7baf15]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.659s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:22 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.45b470c0-c1e1-4615-91e3-d495f71ba3be1yd9kl9s.img {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:14:22 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Converted 1024.00 MB image at 158.36 MB/s
Sep 24 18:14:22 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] 45b470c0-c1e1-4615-91e3-d495f71ba3be was raw, no need to convert to raw {{(pid=84502) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 24 18:14:32 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.599s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:14:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Uploaded volume to glance image-id: 45b470c0-c1e1-4615-91e3-d495f71ba3be. {{(pid=84502) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 24 18:14:51 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-55bf0026-dea1-480c-92fa-6ae947e3202e tempest-VolumesActionsTest-1508949558 None] Copy volume to image completed successfully.
Sep 24 18:14:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:14:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:14:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:14:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e7cbb2-a6ae-4934-a3eb-5a9ddd8388c2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.424s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:53 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7a4c48-fb6f-4c7f-be0c-d81061e6e9aa]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.428s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img" returned: 0 in 5.591s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:59 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[35281a63-34de-4e7a-b1d9-f05c9a871768]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:14:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.562s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:59 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:14:59 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Converted 1024.00 MB image at 182.10 MB/s
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] 513df042-4947-4848-94d1-0af7f5324799 was raw, converting to qcow2 {{(pid=84502) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfcb71a-0f47-4b0b-a8f5-9a345b94b044]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img" returned: 0 in 0.342s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img" returned: 1 in 0.334s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:15:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img /opt/stack/data/cinder/conversion/vol_upload__az0p4pp {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img /opt/stack/data/cinder/conversion/vol_upload__az0p4pp" returned: 0 in 0.440s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:01 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Image conversion details: src /opt/stack/data/cinder/conversion/7354da0c-65f9-4810-a47a-c20d56ac4583.temp_image.513df042-4947-4848-94d1-0af7f5324799u0k3_fm8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__az0p4pp {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:15:01 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 24 18:15:01 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd07b88-bff7-4285-938a-d1cff0b12c88]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__az0p4pp {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__az0p4pp" returned: 0 in 0.354s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.320s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:03 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Uploaded volume to glance image-id: 513df042-4947-4848-94d1-0af7f5324799. {{(pid=84502) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 24 18:15:03 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fb1b1b69-b9fa-4abb-aeed-1c9416421ef9 tempest-VolumesActionsTest-1508949558 None] Copy volume to image completed successfully.
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:04 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Acquiring lock "cinder-quobyte-7354da0c-65f9-4810-a47a-c20d56ac4583" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "cinder-quobyte-7354da0c-65f9-4810-a47a-c20d56ac4583" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d09bfe-20b4-4093-89d4-501f3347f562]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:04 devstack quobyte-client[84528]: System call of process 98328 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.428s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7354da0c-65f9-4810-a47a-c20d56ac4583" returned: 0 in 0.092s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "cinder-quobyte-7354da0c-65f9-4810-a47a-c20d56ac4583" released by "delete_volume" :: held 0.672s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Created reservations ['d092b2bd-0dd0-4489-a846-7b2b9f108e49', 'cc6591fe-f0fc-4797-bfb7-698ffe94f96e', '0c06a072-3729-4ae0-acee-e88decfa9fb1', 'e02c57f6-fec7-4ead-b01e-59944c38f56b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:05 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Deleted volume successfully.
Sep 24 18:15:05 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-be879f9c-a3ee-4b30-9c67-7fa69725b12e tempest-VolumesActionsTest-1508949558 None] Lock "cinder-7354da0c-65f9-4810-a47a-c20d56ac4583-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (d4c3441b-a9aa-478d-b219-cd444257bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb68cdc-6eb1-4ee4-840d-8c7de25b8603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb68cdc-6eb1-4ee4-840d-8c7de25b8603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696685479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59c1ca2-077e-4b62-b621-0b4f8c06320f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:14Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa5807-dde0-410d-aac9-0c432300daea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64fa5807-dde0-410d-aac9-0c432300daea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e77d318-c362-45fa-8920-204a2510c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e77d318-c362-45fa-8920-204a2510c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59c1ca2-077e-4b62-b621-0b4f8c06320f', 'volume_name': 'volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb3325c-507a-4c93-b5e4-d53cb13e1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb3325c-507a-4c93-b5e4-d53cb13e1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ed305-6ea7-413d-ae6d-ae4de0be47de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Volume b59c1ca2-077e-4b62-b621-0b4f8c06320f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f', 'volume_size': 1}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696685479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59c1ca2-077e-4b62-b621-0b4f8c06320f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:14Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Creating volume b59c1ca2-077e-4b62-b621-0b4f8c06320f {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:14 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:14 devstack quobyte-client[84528]: System call of process 98338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:14 devstack quobyte-client[84528]: System call of process 98338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:14 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=128, name=volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f 1073741824" returned: 0 in 0.374s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:15:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.563s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ed305-6ea7-413d-ae6d-ae4de0be47de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be605c4-c17a-4cea-9f4b-b0fc1e570f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:15 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Volume volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f (b59c1ca2-077e-4b62-b621-0b4f8c06320f): created successfully
Sep 24 18:15:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be605c4-c17a-4cea-9f4b-b0fc1e570f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (d4c3441b-a9aa-478d-b219-cd444257bb27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b9026fec-fdfe-4663-a62b-6e018346d693 tempest-VolumesListTestJSON-1010495588 None] Created volume successfully.
Sep 24 18:15:17 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (59eebe3b-4d7a-44c2-932a-b484ed1e49b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fd1c0b-9eec-4455-b2ec-14751f07f97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fd1c0b-9eec-4455-b2ec-14751f07f97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249474242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4184a-890f-4ccc-b960-3eaf5a066532,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:17Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68db9fe4-4d99-4723-9e59-7c824ac73cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68db9fe4-4d99-4723-9e59-7c824ac73cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a69440-9a15-4b82-8a43-79129e8c743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a69440-9a15-4b82-8a43-79129e8c743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac4184a-890f-4ccc-b960-3eaf5a066532', 'volume_name': 'volume-fac4184a-890f-4ccc-b960-3eaf5a066532', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afeeddf9-f325-4322-a51b-0ccfc69010c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afeeddf9-f325-4322-a51b-0ccfc69010c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f35069-5969-44e3-81b6-e626f9478449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Volume fac4184a-890f-4ccc-b960-3eaf5a066532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac4184a-890f-4ccc-b960-3eaf5a066532', 'volume_size': 1}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249474242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac4184a-890f-4ccc-b960-3eaf5a066532,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:17Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Creating volume fac4184a-890f-4ccc-b960-3eaf5a066532 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:17 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:17 devstack quobyte-client[84528]: System call of process 98342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:17 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=129, name=volume-fac4184a-890f-4ccc-b960-3eaf5a066532, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.180s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532 1073741824" returned: 0 in 0.453s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532" returned: 0 in 0.095s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] <== create_volume: return (604ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:15:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f35069-5969-44e3-81b6-e626f9478449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac4184a-890f-4ccc-b960-3eaf5a066532', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b3a13-14a3-40b9-b35f-942aa59d605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:18 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Volume volume-fac4184a-890f-4ccc-b960-3eaf5a066532 (fac4184a-890f-4ccc-b960-3eaf5a066532): created successfully
Sep 24 18:15:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6b3a13-14a3-40b9-b35f-942aa59d605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (59eebe3b-4d7a-44c2-932a-b484ed1e49b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:18 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8912860e-6fca-4820-b7f2-ce42873c92aa tempest-VolumesListTestJSON-1010495588 None] Created volume successfully.
Sep 24 18:15:19 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (d8dfa606-6674-490d-b9f9-98c33101596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4418585-df26-43e5-934f-fcd9dee8f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4418585-df26-43e5-934f-fcd9dee8f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1287166625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5d642d-b816-4a67-bae3-f9170b35c24d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:19Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06dc21cd-fa7e-4bc0-ad87-30650502f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06dc21cd-fa7e-4bc0-ad87-30650502f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c8de7d-cffa-4001-8307-2d5ca12056b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c8de7d-cffa-4001-8307-2d5ca12056b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5d642d-b816-4a67-bae3-f9170b35c24d', 'volume_name': 'volume-cb5d642d-b816-4a67-bae3-f9170b35c24d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9656b0-7ef9-4f16-9a1d-5da5c9238a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9656b0-7ef9-4f16-9a1d-5da5c9238a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b056e177-b854-4d35-86d4-6250602e8070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Volume cb5d642d-b816-4a67-bae3-f9170b35c24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5d642d-b816-4a67-bae3-f9170b35c24d', 'volume_size': 1}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1287166625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb5d642d-b816-4a67-bae3-f9170b35c24d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7fc35e82f40942629aa406637bc30a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:19Z,use_quota=True,user_id='864b0f6873314cd5a9fa9c49bf728af3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Creating volume cb5d642d-b816-4a67-bae3-f9170b35c24d {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:19 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:15:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:19 devstack quobyte-client[84528]: System call of process 98349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:19 devstack quobyte-client[84528]: System call of process 98349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:19 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=130, name=volume-cb5d642d-b816-4a67-bae3-f9170b35c24d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d 1073741824" returned: 0 in 0.425s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d" returned: 0 in 0.126s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] <== create_volume: return (620ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.631s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b056e177-b854-4d35-86d4-6250602e8070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5d642d-b816-4a67-bae3-f9170b35c24d', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c903fd90-230a-44f4-a0fb-64842b4d8209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:20 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Volume volume-cb5d642d-b816-4a67-bae3-f9170b35c24d (cb5d642d-b816-4a67-bae3-f9170b35c24d): created successfully
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c903fd90-230a-44f4-a0fb-64842b4d8209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:20 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Flow 'volume_create_manager' (d8dfa606-6674-490d-b9f9-98c33101596a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-368d73b8-2019-4cef-93e6-8cd11e4487f1 tempest-VolumesListTestJSON-1010495588 None] Created volume successfully.
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-cb5d642d-b816-4a67-bae3-f9170b35c24d-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-cb5d642d-b816-4a67-bae3-f9170b35c24d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-quobyte-cb5d642d-b816-4a67-bae3-f9170b35c24d" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-cb5d642d-b816-4a67-bae3-f9170b35c24d" acquired by "delete_volume" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1382971-c525-4564-b8d9-90efb8a9a91c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d" returned: 0 in 0.464s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cb5d642d-b816-4a67-bae3-f9170b35c24d" returned: 0 in 0.101s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:25 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-cb5d642d-b816-4a67-bae3-f9170b35c24d" released by "delete_volume" :: held 0.776s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Created reservations ['c2828e45-283d-4da5-ba79-1ac4aa018ae0', '2546c632-6f8c-4739-8358-3ea6599285e4', '4d1b9a26-6e85-4848-98ef-ba81ecda5d18', 'adc8b3e4-5126-4397-8955-b528a96a8207'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Deleted volume successfully.
Sep 24 18:15:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7cb889f-d84a-4844-ad16-4f454cb0a4ac tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-cb5d642d-b816-4a67-bae3-f9170b35c24d-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-fac4184a-890f-4ccc-b960-3eaf5a066532-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-fac4184a-890f-4ccc-b960-3eaf5a066532-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-quobyte-fac4184a-890f-4ccc-b960-3eaf5a066532" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-fac4184a-890f-4ccc-b960-3eaf5a066532" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[72134796-18c3-4f58-9854-15049347f955]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:27 devstack quobyte-client[84528]: System call of process 98360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532" returned: 0 in 0.403s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-fac4184a-890f-4ccc-b960-3eaf5a066532" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-fac4184a-890f-4ccc-b960-3eaf5a066532" released by "delete_volume" :: held 0.677s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Created reservations ['5f7693de-05a6-4090-b310-e475c712ed35', '5f49763c-81dc-4d2e-83bf-a5118fe5b9a3', '7822cc79-d082-4140-91fc-436b01cca7cc', 'ffc97f25-d260-4790-b161-98bd0b09c026'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:28 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Deleted volume successfully.
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-65dcd5cd-706a-4ccf-bf10-de8a32b236b6 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-fac4184a-890f-4ccc-b960-3eaf5a066532-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-b59c1ca2-077e-4b62-b621-0b4f8c06320f-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-b59c1ca2-077e-4b62-b621-0b4f8c06320f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:29 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "cinder-quobyte-b59c1ca2-077e-4b62-b621-0b4f8c06320f" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-b59c1ca2-077e-4b62-b621-0b4f8c06320f" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344c49b-05dd-4230-a591-93204d03cd26]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f" returned: 0 in 0.467s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b59c1ca2-077e-4b62-b621-0b4f8c06320f" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-quobyte-b59c1ca2-077e-4b62-b621-0b4f8c06320f" released by "delete_volume" :: held 0.728s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:30 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Created reservations ['99238b60-8510-4607-a2b0-e727f34a3d8a', '8d126841-ad22-404c-829d-e3c1ba9cb36d', '0bc9f0b9-5b8b-4643-8a32-032f9f6c9f96', 'bc924983-2b15-4481-b9e3-a91d89125bc4'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Deleted volume successfully.
Sep 24 18:15:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-3063cd8b-c5a2-4d53-8c73-3c4bb4e82e32 tempest-VolumesListTestJSON-1010495588 None] Lock "cinder-b59c1ca2-077e-4b62-b621-0b4f8c06320f-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:41 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=37,cinder:SELECT=27,cinder:INSERT=6,cinder:DELETE=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:15:41 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=25,cinder:UPDATE=42,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:15:55 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:55 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (61c6e1bc-bda5-4c9c-8017-3a063548d9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aef4b2-ebe4-4cbf-b9a8-5adc4ac0aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47aef4b2-ebe4-4cbf-b9a8-5adc4ac0aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-56083669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30653c45-2da8-4228-bb01-56b3ee335365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:56Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7706a411-53e5-4dac-921c-7c23841851d6),volume_type_id=7706a411-53e5-4dac-921c-7c23841851d6)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c9bf6e-f3ec-41e9-a30a-b6ae4fb938c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c9bf6e-f3ec-41e9-a30a-b6ae4fb938c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6afa9c-12cd-4994-9fac-2d6109d3198d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6afa9c-12cd-4994-9fac-2d6109d3198d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30653c45-2da8-4228-bb01-56b3ee335365', 'volume_name': 'volume-30653c45-2da8-4228-bb01-56b3ee335365', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8295d649-6241-4fe1-8f18-a125ae09f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8295d649-6241-4fe1-8f18-a125ae09f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299a8ecf-cd46-4ef2-9a5b-7eb0de280fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Volume 30653c45-2da8-4228-bb01-56b3ee335365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30653c45-2da8-4228-bb01-56b3ee335365', 'volume_size': 1}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-56083669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30653c45-2da8-4228-bb01-56b3ee335365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:56Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7706a411-53e5-4dac-921c-7c23841851d6),volume_type_id=7706a411-53e5-4dac-921c-7c23841851d6)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Creating volume 30653c45-2da8-4228-bb01-56b3ee335365 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:56 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:56 devstack quobyte-client[84528]: System call of process 98405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:56 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=131, name=volume-30653c45-2da8-4228-bb01-56b3ee335365, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 1073741824" returned: 0 in 0.669s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365" returned: 0 in 0.219s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:57 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (a43e2267-6baf-4bad-baf9-46c4a2f6869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c6318f-aa58-405a-aa64-9a091c904a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299a8ecf-cd46-4ef2-9a5b-7eb0de280fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30653c45-2da8-4228-bb01-56b3ee335365', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791db9a0-5314-4336-8b74-55fd7ef32b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c6318f-aa58-405a-aa64-9a091c904a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-518375775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd23f269-5f20-4792-8c19-67acef9504cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:57Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5832c083-3e5f-416f-8a2f-613177746aa1),volume_type_id=5832c083-3e5f-416f-8a2f-613177746aa1)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21381818-b646-4b6e-a426-f09e5842e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21381818-b646-4b6e-a426-f09e5842e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facab949-7160-49e9-b14b-d79d9d8636ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (facab949-7160-49e9-b14b-d79d9d8636ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd23f269-5f20-4792-8c19-67acef9504cd', 'volume_name': 'volume-cd23f269-5f20-4792-8c19-67acef9504cd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d3360c-9d34-4a14-8ae7-575cb0284ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d3360c-9d34-4a14-8ae7-575cb0284ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f41cce3-c1e6-46fb-9957-1b2e89bccbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume cd23f269-5f20-4792-8c19-67acef9504cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd23f269-5f20-4792-8c19-67acef9504cd', 'volume_size': 1}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-518375775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd23f269-5f20-4792-8c19-67acef9504cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:57Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5832c083-3e5f-416f-8a2f-613177746aa1),volume_type_id=5832c083-3e5f-416f-8a2f-613177746aa1)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Creating volume cd23f269-5f20-4792-8c19-67acef9504cd {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:57 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:57 devstack quobyte-client[84528]: System call of process 98409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:57 devstack quobyte-client[84528]: System call of process 98409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:57 devstack quobyte-client[84528]: System call of process 98409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:57 devstack quobyte-client[84528]: System call of process 98409 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:57 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=132, name=volume-cd23f269-5f20-4792-8c19-67acef9504cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:15:57 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Volume volume-30653c45-2da8-4228-bb01-56b3ee335365 (30653c45-2da8-4228-bb01-56b3ee335365): created successfully
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (791db9a0-5314-4336-8b74-55fd7ef32b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:57 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (61c6e1bc-bda5-4c9c-8017-3a063548d9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c0515dd7-ea29-413a-b1ef-a7f85631795f tempest-TestInstancesWithCinderVolumes-700343530 None] Created volume successfully.
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd 1073741824" returned: 0 in 0.555s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (55049f4b-5c4a-4e3c-9049-d2050ad8ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f295882d-17cd-477f-bacb-0297f29b6d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f295882d-17cd-477f-bacb-0297f29b6d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1782691232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e93719-3e73-4db6-ba75-989074fba434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:58Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b43d1545-f8dc-48d8-928a-b61dc8ec6971),volume_type_id=b43d1545-f8dc-48d8-928a-b61dc8ec6971)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea431f6-6793-496a-8866-49b3d07430a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea431f6-6793-496a-8866-49b3d07430a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fbfeb2-da2f-4069-9b60-2e6b32fec546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd" returned: 0 in 0.546s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f41cce3-c1e6-46fb-9957-1b2e89bccbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd23f269-5f20-4792-8c19-67acef9504cd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15425550-618c-4144-b412-3e7743b0c947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume volume-cd23f269-5f20-4792-8c19-67acef9504cd (cd23f269-5f20-4792-8c19-67acef9504cd): created successfully
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15425550-618c-4144-b412-3e7743b0c947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (a43e2267-6baf-4bad-baf9-46c4a2f6869d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:58 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8fc1dc1d-005c-462b-bc40-2494fc4ee6f9 tempest-TestInstancesWithCinderVolumes-700343530 None] Created volume successfully.
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fbfeb2-da2f-4069-9b60-2e6b32fec546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6e93719-3e73-4db6-ba75-989074fba434', 'volume_name': 'volume-b6e93719-3e73-4db6-ba75-989074fba434', 'volume_size': 1, 'image_id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083333668', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97a6a1a84a914e909f75bd6adcefd38a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'created_at': datetime.datetime(2025, 9, 24, 16, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89c3839-141a-4f94-80ad-14ae4d652964/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90884a00>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d0ae55-5417-4f7a-962d-a726e6bae333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d0ae55-5417-4f7a-962d-a726e6bae333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14bb6a3-0093-493c-a620-38f6f1788f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:59 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Volume b6e93719-3e73-4db6-ba75-989074fba434: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6e93719-3e73-4db6-ba75-989074fba434', 'volume_size': 1, 'image_id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083333668', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97a6a1a84a914e909f75bd6adcefd38a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'created_at': datetime.datetime(2025, 9, 24, 16, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89c3839-141a-4f94-80ad-14ae4d652964/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90884a00>}
Sep 24 18:15:59 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Cloning b6e93719-3e73-4db6-ba75-989074fba434 from image c89c3839-141a-4f94-80ad-14ae4d652964  at location (None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:16:00 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD, size 20.69 MB, duration 1.43 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:16:00 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Image download 20.69 MB at 14.48 MB/s
Sep 24 18:16:00 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30e148-bed1-4a99-9a14-46094286a668]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:00 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD
Sep 24 18:16:00 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:16:02 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Sep 24 18:16:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD" returned: 0 in 2.002s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:02 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Temporary image c89c3839-141a-4f94-80ad-14ae4d652964 is fetched for user b86473b2ec9749cbbf561eb2ff784b86. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:16:02 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63d0984-9a04-4acd-95fe-1ec8e21a42ba]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:03 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD
Sep 24 18:16:03 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:16:04 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD" returned: 0 in 1.891s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1782691232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e93719-3e73-4db6-ba75-989074fba434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a6a1a84a914e909f75bd6adcefd38a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:58Z,use_quota=True,user_id='b86473b2ec9749cbbf561eb2ff784b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b43d1545-f8dc-48d8-928a-b61dc8ec6971),volume_type_id=b43d1545-f8dc-48d8-928a-b61dc8ec6971)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Creating volume b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:16:04 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:16:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:04 devstack quobyte-client[84528]: System call of process 98430 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:16:05 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=133, name=volume-b6e93719-3e73-4db6-ba75-989074fba434, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 1073741824" returned: 0 in 0.364s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] <== create_volume: return (546ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.584s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Attempting download of c89c3839-141a-4f94-80ad-14ae4d652964 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}])) to volume b6e93719-3e73-4db6-ba75-989074fba434. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9b5d5f-0b76-4636-bdcf-0760efa42bd4]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89c3839-141a-4f94-80ad-14ae4d652964_lwt_kwz7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c89c3839-141a-4f94-80ad-14ae4d652964_lwt_kwz7" returned: 0 in 0.326s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89c3839-141a-4f94-80ad-14ae4d652964_lwt_kwz7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89c3839-141a-4f94-80ad-14ae4d652964_lwt_kwz7" returned: 1 in 0.357s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c89c3839-141a-4f94-80ad-14ae4d652964_lwt_kwz7' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[94388c3a-aa01-4ceb-805b-bbb00deab6aa]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] c89c3839-141a-4f94-80ad-14ae4d652964 was qcow2, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:16:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:07 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=133, name=volume-b6e93719-3e73-4db6-ba75-989074fba434, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:16:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.985s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:07 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c89c3839-141a-4f94-80ad-14ae4d652964_x__8o0cjdevstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:16:07 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Converted 112.00 MB image at 110.13 MB/s
Sep 24 18:16:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 1G" returned: 0 in 0.133s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:08 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df33fe6-aad5-4ceb-b789-3f37282961a4]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:08 devstack quobyte-client[84528]: System call of process 98454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:16:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.427s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:09 devstack quobyte-client[84528]: System call of process 98456 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 1 in 0.383s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Downloaded image c89c3839-141a-4f94-80ad-14ae4d652964 ((None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}])) to volume b6e93719-3e73-4db6-ba75-989074fba434 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Temporary image c89c3839-141a-4f94-80ad-14ae4d652964 for user b86473b2ec9749cbbf561eb2ff784b86 is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Marking volume b6e93719-3e73-4db6-ba75-989074fba434 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Copying metadata from image c89c3839-141a-4f94-80ad-14ae4d652964 to b6e93719-3e73-4db6-ba75-989074fba434. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Creating volume glance metadata for volume b6e93719-3e73-4db6-ba75-989074fba434 backed by image c89c3839-141a-4f94-80ad-14ae4d652964 with: {'image_id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'image_name': 'tempest-scenario-img--1083333668', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14bb6a3-0093-493c-a620-38f6f1788f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e93719-3e73-4db6-ba75-989074fba434', 'volume_size': 1, 'image_id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c89c3839-141a-4f94-80ad-14ae4d652964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1083333668', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97a6a1a84a914e909f75bd6adcefd38a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c89c3839-141a-4f94-80ad-14ae4d652964', 'created_at': datetime.datetime(2025, 9, 24, 16, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c89c3839-141a-4f94-80ad-14ae4d652964/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b90884a00>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc28c941-b136-4ae9-896b-3b634ef91e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Volume volume-b6e93719-3e73-4db6-ba75-989074fba434 (b6e93719-3e73-4db6-ba75-989074fba434): created successfully
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc28c941-b136-4ae9-896b-3b634ef91e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Flow 'volume_create_manager' (55049f4b-5c4a-4e3c-9049-d2050ad8ce51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:16:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5fcd3acb-1436-449a-9f90-ecf006963bca tempest-TestInstancesWithCinderVolumes-700343530 None] Created volume successfully.
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:16:19 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:19 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:DELETE=3,cinder:INSERT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace112cd-cd60-4f29-80ab-73513a5987a8]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:20 devstack quobyte-client[84528]: System call of process 98472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.668s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:21 devstack quobyte-client[84528]: System call of process 98475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:16:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 1 in 0.424s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:16:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.411s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:21 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-b6e93719-3e73-4db6-ba75-989074fba434', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '085012e5-e1c2-42aa-9185-c092ce75edd7', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:16:21 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:16:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4abad0fb-b783-4a45-9ae0-458e56d85ef3 req-8ad730b6-5a79-4df9-8605-85c4aa0cbcec tempest-TestInstancesWithCinderVolumes-700343530 None] attachment_update completed successfully.
Sep 24 18:16:32 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:32 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.106s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:17:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc8a0fa-624f-4d68-bba2-27fd44916e1f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:17:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:40 devstack quobyte-client[84528]: System call of process 99064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:17:40 devstack quobyte-client[84528]: System call of process 99064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:17:40 devstack quobyte-client[84528]: System call of process 99064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:17:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365" returned: 0 in 0.499s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.590s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-30653c45-2da8-4228-bb01-56b3ee335365', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1201cc9-fe50-4294-8f47-4f168ea68ff4', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:17:40 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:17:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-4d4aca86-d544-4170-9ad6-29ebae6d11bb req-28c0fa88-961b-4d84-8bec-9ec565e772e3 tempest-TestInstancesWithCinderVolumes-700343530 None] attachment_update completed successfully.
Sep 24 18:17:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aef9e8-e11d-46af-ba8f-8617980ba111]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:17:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:50 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd" returned: 0 in 0.449s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.493s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-cd23f269-5f20-4792-8c19-67acef9504cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3421da23-ae4d-4192-92f7-d51d2674a5af', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:17:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:17:51 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-c3692e5e-2af9-4bc5-a432-ac1687815d29 req-7cb0e2ae-c38b-47d5-9d5c-66aa4af33194 tempest-TestInstancesWithCinderVolumes-700343530 None] attachment_update completed successfully.
Sep 24 18:18:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.083s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:18:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-5045e636-19b2-43fc-85c2-077e431866a4 req-e8d389e6-d96a-465c-9986-2c0af014c28c tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-5045e636-19b2-43fc-85c2-077e431866a4 req-e8d389e6-d96a-465c-9986-2c0af014c28c tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-5045e636-19b2-43fc-85c2-077e431866a4 req-e8d389e6-d96a-465c-9986-2c0af014c28c tempest-TestInstancesWithCinderVolumes-700343530 None] Terminate volume connection completed successfully.
Sep 24 18:18:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-5045e636-19b2-43fc-85c2-077e431866a4 req-e8d389e6-d96a-465c-9986-2c0af014c28c tempest-TestInstancesWithCinderVolumes-700343530 None] Deleting attachment b1201cc9-fe50-4294-8f47-4f168ea68ff4. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:18:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-30653c45-2da8-4228-bb01-56b3ee335365-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:18:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-30653c45-2da8-4228-bb01-56b3ee335365-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:18:28 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-quobyte-30653c45-2da8-4228-bb01-56b3ee335365" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-30653c45-2da8-4228-bb01-56b3ee335365" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b68fd14-d55e-47ea-bf3c-f78a235abf8b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:28 devstack quobyte-client[84528]: System call of process 99216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365" returned: 0 in 0.556s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-30653c45-2da8-4228-bb01-56b3ee335365" returned: 0 in 0.109s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-30653c45-2da8-4228-bb01-56b3ee335365" released by "delete_volume" :: held 0.857s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:18:29 devstack cinder-volume[84502]: WARNING cinder.quota [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2117565440-325746785 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2117565440-325746785, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:18:29 devstack cinder-volume[84502]: WARNING cinder.quota [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2117565440-325746785 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2117565440-325746785, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Created reservations ['b51ff6ef-7dd9-4785-936a-07c0e7734c76', '5d381091-e72d-4a03-9555-86e70b9c0515', '500d63ed-c97c-40bf-a7f7-08457ac50a2b', '6aa1e9d8-d411-4b55-bfd2-3c11998c33a6'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:18:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Deleted volume successfully.
Sep 24 18:18:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-b3f0a92c-7e4d-4582-aaf4-514c00495a0b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-30653c45-2da8-4228-bb01-56b3ee335365-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:18:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:39 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=4,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-95a7a42b-e65e-4f22-8062-b337360ecdb4 req-158ffb0c-6351-4deb-82f1-b75bf7e31bd0 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:56 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-95a7a42b-e65e-4f22-8062-b337360ecdb4 req-158ffb0c-6351-4deb-82f1-b75bf7e31bd0 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:56 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-95a7a42b-e65e-4f22-8062-b337360ecdb4 req-158ffb0c-6351-4deb-82f1-b75bf7e31bd0 tempest-TestInstancesWithCinderVolumes-700343530 None] Terminate volume connection completed successfully.
Sep 24 18:18:56 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-95a7a42b-e65e-4f22-8062-b337360ecdb4 req-158ffb0c-6351-4deb-82f1-b75bf7e31bd0 tempest-TestInstancesWithCinderVolumes-700343530 None] Deleting attachment 3421da23-ae4d-4192-92f7-d51d2674a5af. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-cd23f269-5f20-4792-8c19-67acef9504cd-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-cd23f269-5f20-4792-8c19-67acef9504cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:18:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-quobyte-cd23f269-5f20-4792-8c19-67acef9504cd" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-cd23f269-5f20-4792-8c19-67acef9504cd" acquired by "delete_volume" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f990f-384c-4a0e-a99c-e522957caf73]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:18:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd" returned: 0 in 0.567s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-cd23f269-5f20-4792-8c19-67acef9504cd" returned: 0 in 0.104s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-cd23f269-5f20-4792-8c19-67acef9504cd" released by "delete_volume" :: held 0.876s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:18:59 devstack cinder-volume[84502]: WARNING cinder.quota [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1412884819-1818080298 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1412884819-1818080298, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:18:59 devstack cinder-volume[84502]: WARNING cinder.quota [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1412884819-1818080298 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1412884819-1818080298, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Created reservations ['91d02bd1-3954-4c3b-9253-9dca6727aa99', 'e12bcffe-1667-431d-9453-2c509852e251', '71aab1f1-154f-406c-90cc-13fa846daeae', '9efebf71-a711-43de-bebd-2bb9b77e9498'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.151s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:00 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:19:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Deleted volume successfully.
Sep 24 18:19:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-5ca12beb-9a2a-470c-86ac-2b0df4835d56 tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-cd23f269-5f20-4792-8c19-67acef9504cd-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:19:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-b93c8b54-d91e-45a4-8acf-148a20cc7819 req-ec26ee0c-a2b8-407b-a4a7-dcc21ae79209 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:19:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-b93c8b54-d91e-45a4-8acf-148a20cc7819 req-ec26ee0c-a2b8-407b-a4a7-dcc21ae79209 tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:19:07 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-b93c8b54-d91e-45a4-8acf-148a20cc7819 req-ec26ee0c-a2b8-407b-a4a7-dcc21ae79209 tempest-TestInstancesWithCinderVolumes-700343530 None] Terminate volume connection completed successfully.
Sep 24 18:19:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-b93c8b54-d91e-45a4-8acf-148a20cc7819 req-ec26ee0c-a2b8-407b-a4a7-dcc21ae79209 tempest-TestInstancesWithCinderVolumes-700343530 None] Deleting attachment 085012e5-e1c2-42aa-9185-c092ce75edd7. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-b6e93719-3e73-4db6-ba75-989074fba434-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-b6e93719-3e73-4db6-ba75-989074fba434-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:19:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "cinder-quobyte-b6e93719-3e73-4db6-ba75-989074fba434" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-b6e93719-3e73-4db6-ba75-989074fba434" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7fedf-1767-4be8-bc28-d457e97cc399]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:19:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:12 devstack quobyte-client[84528]: System call of process 99378 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.402s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:12 devstack quobyte-client[84528]: System call of process 99380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 1 in 0.365s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b6e93719-3e73-4db6-ba75-989074fba434" returned: 0 in 0.121s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-quobyte-b6e93719-3e73-4db6-ba75-989074fba434" released by "delete_volume" :: held 1.121s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:19:13 devstack cinder-volume[84502]: WARNING cinder.quota [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176644023-1606468059 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176644023-1606468059, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:19:13 devstack cinder-volume[84502]: WARNING cinder.quota [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176644023-1606468059 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-176644023-1606468059, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Created reservations ['1d3a3417-0a62-4e2c-bcf8-6a825c8b424f', '105ec6f2-c203-48b0-8966-130b73c71844', '959442a8-b5dc-46f2-a07b-66e349609709', 'a0c5d4a2-9476-450c-a205-829e5d46e848'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.085s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:19:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Deleted volume successfully.
Sep 24 18:19:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dec4f1c9-a63d-4692-bcd9-30933a4b575b tempest-TestInstancesWithCinderVolumes-700343530 None] Lock "cinder-b6e93719-3e73-4db6-ba75-989074fba434-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.127s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:19:23 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:19:23 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=16,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Flow 'volume_create_manager' (6c1dfc1e-3ffd-4b71-bfc2-1c7ef5cb4c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea97ff1a-cfd0-4e69-bd18-5494a56c20b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea97ff1a-cfd0-4e69-bd18-5494a56c20b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1842176602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857225f825bd4d59bc19b26587ebb72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:20:16Z,use_quota=True,user_id='4261c644c19141ef8db34eec9240941f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdc03fb-8bb1-422b-9324-afc097bbdb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcdc03fb-8bb1-422b-9324-afc097bbdb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263de6ac-9b0e-4e31-bedf-633cc318bfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263de6ac-9b0e-4e31-bedf-633cc318bfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5', 'volume_name': 'volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2974b214-b1fc-4886-8a1e-e62d5496ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2974b214-b1fc-4886-8a1e-e62d5496ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9897b728-ba4c-48ec-a048-768cf5d0ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:16 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Volume ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5', 'volume_size': 1}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1842176602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857225f825bd4d59bc19b26587ebb72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:20:16Z,use_quota=True,user_id='4261c644c19141ef8db34eec9240941f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Creating volume ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:20:16 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:20:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:16 devstack quobyte-client[84528]: System call of process 99554 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:20:16 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=134, name=volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 1073741824" returned: 0 in 0.415s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" returned: 0 in 0.197s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] <== create_volume: return (790ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.407s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9897b728-ba4c-48ec-a048-768cf5d0ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c3870-c90c-4245-bc7f-cc84619fa82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:20:17 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Volume volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 (ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5): created successfully
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c3870-c90c-4245-bc7f-cc84619fa82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:20:17 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Flow 'volume_create_manager' (6c1dfc1e-3ffd-4b71-bfc2-1c7ef5cb4c3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:20:17 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ade93cab-78b7-4647-a6f9-be3649ce262d tempest-TestMinimumBasicScenario-1923435728 None] Created volume successfully.
Sep 24 18:20:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[67524f51-2f41-4dd2-ba48-be02b592d516]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:20:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" returned: 0 in 0.479s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.585s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a5c151d-b14f-4f37-be63-4cdacc133ae7', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:20:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:23 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-b0b89e27-e286-4b91-842c-48dc65c5c01d req-54b0f715-693a-45df-aa8a-71061a42e72c tempest-TestMinimumBasicScenario-1923435728 None] attachment_update completed successfully.
Sep 24 18:20:33 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:33 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:21:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:21:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.106s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.124s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:22:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:23:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-d13d1baa-e3d7-4edc-890e-a0cd08987c85 req-062e9e33-f090-427b-85c7-f8092b685486 tempest-TestMinimumBasicScenario-1923435728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:23:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:23:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-d13d1baa-e3d7-4edc-890e-a0cd08987c85 req-062e9e33-f090-427b-85c7-f8092b685486 tempest-TestMinimumBasicScenario-1923435728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:23:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-d13d1baa-e3d7-4edc-890e-a0cd08987c85 req-062e9e33-f090-427b-85c7-f8092b685486 tempest-TestMinimumBasicScenario-1923435728 None] Terminate volume connection completed successfully.
Sep 24 18:23:00 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-d13d1baa-e3d7-4edc-890e-a0cd08987c85 req-062e9e33-f090-427b-85c7-f8092b685486 tempest-TestMinimumBasicScenario-1923435728 None] Deleting attachment 5a5c151d-b14f-4f37-be63-4cdacc133ae7. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "cinder-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "cinder-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:23:03 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "cinder-quobyte-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "cinder-quobyte-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8895f8e-0c66-4008-b743-a2b998c30268]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" returned: 0 in 0.429s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:03 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" returned: 0 in 0.097s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "cinder-quobyte-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5" released by "delete_volume" :: held 0.703s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Created reservations ['0a3ef0e4-091a-4bca-8fb4-0029b49a2550', 'e2d87f12-4757-4a72-8afc-c155d901acc8', '430f5832-b089-430b-887d-48aece400062', '2ab08365-1220-49eb-9470-3767e5a07da5'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:23:04 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Deleted volume successfully.
Sep 24 18:23:04 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ae01ffe5-5673-4b9b-9372-5f2aaed75ba3 tempest-TestMinimumBasicScenario-1923435728 None] Lock "cinder-ec81b9bb-26c0-4c7a-a404-b4e97c5c40b5-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:23:14 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=3 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:23:14 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.152s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:23:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:23:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:23:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Flow 'volume_create_manager' (02ce39aa-8697-452b-ac13-265f87844d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:23:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad13a58-c4df-4492-821d-3902320faf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad13a58-c4df-4492-821d-3902320faf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615174333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cefe52-b074-4e55-b7b2-acd23727153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45024c8bb8ac4d599d0c16d172a18ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:23:51Z,use_quota=True,user_id='d674cb17c7564042a040b085476eeaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac253a4c-2ef9-49c4-aa14-26291feb404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac253a4c-2ef9-49c4-aa14-26291feb404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101f6c88-2262-447e-9374-efd8142d895f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101f6c88-2262-447e-9374-efd8142d895f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cefe52-b074-4e55-b7b2-acd23727153f', 'volume_name': 'volume-99cefe52-b074-4e55-b7b2-acd23727153f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd2613a-4ddc-4117-809d-c201ba15cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd2613a-4ddc-4117-809d-c201ba15cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385571e2-723c-4df8-9ab8-d2211b06d11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:51 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume 99cefe52-b074-4e55-b7b2-acd23727153f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cefe52-b074-4e55-b7b2-acd23727153f', 'volume_size': 1}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-615174333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cefe52-b074-4e55-b7b2-acd23727153f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45024c8bb8ac4d599d0c16d172a18ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:23:51Z,use_quota=True,user_id='d674cb17c7564042a040b085476eeaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Creating volume 99cefe52-b074-4e55-b7b2-acd23727153f {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:23:51 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:51 devstack quobyte-client[84528]: System call of process 100488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:51 devstack quobyte-client[84528]: System call of process 100488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:51 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=135, name=volume-99cefe52-b074-4e55-b7b2-acd23727153f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f 1073741824" returned: 0 in 0.536s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:51 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Flow 'volume_create_manager' (2c8b97ef-e038-40e1-acdc-e511ea634fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:23:51 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fcb52a-abf3-4734-a903-7202b8198f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f" returned: 0 in 0.447s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] <== create_volume: return (1028ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fcb52a-abf3-4734-a903-7202b8198f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2047130560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97799725-1d50-442a-bccb-7790950fc473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45024c8bb8ac4d599d0c16d172a18ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:23:51Z,use_quota=True,user_id='d674cb17c7564042a040b085476eeaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0374638-5b65-45ba-b489-04a036e50c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0374638-5b65-45ba-b489-04a036e50c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a82882-3976-461b-9ca4-e2763a7db34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a82882-3976-461b-9ca4-e2763a7db34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97799725-1d50-442a-bccb-7790950fc473', 'volume_name': 'volume-97799725-1d50-442a-bccb-7790950fc473', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29828e5b-0492-4895-98ef-b6333e65a6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29828e5b-0492-4895-98ef-b6333e65a6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8186665b-34c9-4be2-96ac-39368fee2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume 97799725-1d50-442a-bccb-7790950fc473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97799725-1d50-442a-bccb-7790950fc473', 'volume_size': 1}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2047130560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97799725-1d50-442a-bccb-7790950fc473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45024c8bb8ac4d599d0c16d172a18ce1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:23:51Z,use_quota=True,user_id='d674cb17c7564042a040b085476eeaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Creating volume 97799725-1d50-442a-bccb-7790950fc473 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:23:52 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:52 devstack quobyte-client[84528]: System call of process 100492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:52 devstack quobyte-client[84528]: System call of process 100492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:52 devstack quobyte-client[84528]: System call of process 100492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:52 devstack quobyte-client[84528]: System call of process 100492 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:23:52 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=136, name=volume-97799725-1d50-442a-bccb-7790950fc473, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385571e2-723c-4df8-9ab8-d2211b06d11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cefe52-b074-4e55-b7b2-acd23727153f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba56c51-fada-433d-a20d-eed2afdbf1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 1073741824" returned: 0 in 0.509s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:52 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume volume-99cefe52-b074-4e55-b7b2-acd23727153f (99cefe52-b074-4e55-b7b2-acd23727153f): created successfully
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba56c51-fada-433d-a20d-eed2afdbf1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:52 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Flow 'volume_create_manager' (02ce39aa-8697-452b-ac13-265f87844d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473" returned: 0 in 0.372s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] <== create_volume: return (907ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b34a76fb-bc5e-4f66-857a-ecfcbd3d2ec8 tempest-TestServerVolumeAttachmentScenario-957351984 None] Created volume successfully.
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8186665b-34c9-4be2-96ac-39368fee2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97799725-1d50-442a-bccb-7790950fc473', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0caa93ad-1ace-4eb6-a8bc-a31b3e52b09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:23:53 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume volume-97799725-1d50-442a-bccb-7790950fc473 (97799725-1d50-442a-bccb-7790950fc473): created successfully
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0caa93ad-1ace-4eb6-a8bc-a31b3e52b09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:23:53 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Flow 'volume_create_manager' (2c8b97ef-e038-40e1-acdc-e511ea634fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:23:53 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-883b1c7a-7035-48e2-a228-582fc33953bc tempest-TestServerVolumeAttachmentScenario-957351984 None] Created volume successfully.
Sep 24 18:24:03 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:24:03 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=4,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.157s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:25:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.087s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:25:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[232178ff-e1a7-44d4-8727-3adae95adc94]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:28 devstack quobyte-client[84528]: System call of process 100718 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f" returned: 0 in 0.421s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.488s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-99cefe52-b074-4e55-b7b2-acd23727153f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dda5b73a-08e2-4751-a17b-9dfd7bf78d10', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:25:28 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-2f7442af-cefc-4d0a-888b-3ae3cc49fc2f req-2b67c919-8652-4f45-bba9-b6a55ce4ff65 tempest-TestServerVolumeAttachmentScenario-957351984 None] attachment_update completed successfully.
Sep 24 18:25:38 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:38 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea680ce-f499-4a72-b1b4-6e058af2ef53]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:43 devstack quobyte-client[84528]: System call of process 101351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:43 devstack quobyte-client[84528]: System call of process 101351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:43 devstack quobyte-client[84528]: System call of process 101351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473" returned: 0 in 0.537s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.615s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-97799725-1d50-442a-bccb-7790950fc473', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7292c46-3687-43e9-b7ab-2b88453628b4', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:25:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-65551ec3-8581-4484-a4fe-8fc5846abe44 req-77edba1f-44ec-43af-ab82-ff5009bfb6db tempest-TestServerVolumeAttachmentScenario-957351984 None] attachment_update completed successfully.
Sep 24 18:25:54 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:54 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-0a56dc3c-e9ef-4d8c-bf83-072aa30b3cfb req-cdf50144-2f20-475b-a72c-b3f9b6bd1d36 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-0a56dc3c-e9ef-4d8c-bf83-072aa30b3cfb req-cdf50144-2f20-475b-a72c-b3f9b6bd1d36 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-0a56dc3c-e9ef-4d8c-bf83-072aa30b3cfb req-cdf50144-2f20-475b-a72c-b3f9b6bd1d36 tempest-TestServerVolumeAttachmentScenario-957351984 None] Terminate volume connection completed successfully.
Sep 24 18:26:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-0a56dc3c-e9ef-4d8c-bf83-072aa30b3cfb req-cdf50144-2f20-475b-a72c-b3f9b6bd1d36 tempest-TestServerVolumeAttachmentScenario-957351984 None] Deleting attachment a7292c46-3687-43e9-b7ab-2b88453628b4. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:22 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:22 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-fdd039d5-0311-4fd6-a362-c38063b8e3e1 req-db0fbe89-5d86-44b4-8f78-1d45c203ee62 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-fdd039d5-0311-4fd6-a362-c38063b8e3e1 req-db0fbe89-5d86-44b4-8f78-1d45c203ee62 tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:36 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-fdd039d5-0311-4fd6-a362-c38063b8e3e1 req-db0fbe89-5d86-44b4-8f78-1d45c203ee62 tempest-TestServerVolumeAttachmentScenario-957351984 None] Terminate volume connection completed successfully.
Sep 24 18:26:36 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-fdd039d5-0311-4fd6-a362-c38063b8e3e1 req-db0fbe89-5d86-44b4-8f78-1d45c203ee62 tempest-TestServerVolumeAttachmentScenario-957351984 None] Deleting attachment dda5b73a-08e2-4751-a17b-9dfd7bf78d10. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:26:46 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:46 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "cinder-97799725-1d50-442a-bccb-7790950fc473-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-97799725-1d50-442a-bccb-7790950fc473-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:47 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "cinder-quobyte-97799725-1d50-442a-bccb-7790950fc473" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-quobyte-97799725-1d50-442a-bccb-7790950fc473" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bafa4e-91f6-486a-86b0-478629306d22]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473" returned: 0 in 0.446s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-97799725-1d50-442a-bccb-7790950fc473" returned: 0 in 0.097s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-quobyte-97799725-1d50-442a-bccb-7790950fc473" released by "delete_volume" :: held 0.741s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:48 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Created reservations ['1b0f7197-aacf-4987-b12a-d0f2945b0f20', 'f8c6ac57-7172-43a9-8c05-02af94d5955d', '43b4c3e8-7f96-445d-897c-a93fe29fe37b', 'dc1e5ac3-3966-42f6-9525-cb6304480238'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.182s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Deleted volume successfully.
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d1bdf06b-130e-4f91-a783-855d5ce52ebe tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-97799725-1d50-442a-bccb-7790950fc473-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "cinder-99cefe52-b074-4e55-b7b2-acd23727153f-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-99cefe52-b074-4e55-b7b2-acd23727153f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "cinder-quobyte-99cefe52-b074-4e55-b7b2-acd23727153f" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-quobyte-99cefe52-b074-4e55-b7b2-acd23727153f" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb6920a-8a82-4faa-811d-eb00be4f43a9]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f" returned: 0 in 0.420s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-99cefe52-b074-4e55-b7b2-acd23727153f" returned: 0 in 0.092s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-quobyte-99cefe52-b074-4e55-b7b2-acd23727153f" released by "delete_volume" :: held 0.788s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Created reservations ['76270a61-4304-4d88-a818-1901df5b7295', 'e347bd9e-d9a2-4c79-bace-290ba09dd692', 'ff92747e-9621-486f-93a8-6a3c491858f1', '14e153b6-c400-4704-a2af-50b665a72c43'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.106s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:51 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Deleted volume successfully.
Sep 24 18:26:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-7b083be2-2251-4769-a96e-1917e2307e2e tempest-TestServerVolumeAttachmentScenario-957351984 None] Lock "cinder-99cefe52-b074-4e55-b7b2-acd23727153f-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=16 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:01 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=17,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.105s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:40 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Flow 'volume_create_manager' (17f35509-a666-4cfb-8e35-a0286deb71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e892df-6fd3-4c5f-90f4-74e430231527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e892df-6fd3-4c5f-90f4-74e430231527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106134831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d19cf67-fa08-40ee-ae37-bd004e412dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5779e7e7b29f4782ad4aaf1161cae1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:40Z,use_quota=True,user_id='9e5793942b7c454d8d7a45cf2b80b698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fb0017-0dbc-4ecd-b6ee-895204f5db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fb0017-0dbc-4ecd-b6ee-895204f5db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018625cd-ff1d-48b1-b853-fc7c34e387ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018625cd-ff1d-48b1-b853-fc7c34e387ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'volume_name': 'volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b863ea260>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d086a6-2be6-48f6-9bae-25243624122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d086a6-2be6-48f6-9bae-25243624122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2a0db6-1250-4f54-a224-7fdf96fb6010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:40 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b863ea260>}
Sep 24 18:27:40 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Cloning 9d19cf67-fa08-40ee-ae37-bd004e412dd5 from image a414f1aa-0123-4732-9dda-73666cba7ecf  at location (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:27:41 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:27:41 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Image download 20.69 MB at 20.69 MB/s
Sep 24 18:27:41 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c796bf-f85e-45a9-9128-1c4f63ba377c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:41 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD
Sep 24 18:27:41 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:27:43 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Sep 24 18:27:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD" returned: 0 in 2.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:43 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf is fetched for user 9e5793942b7c454d8d7a45cf2b80b698. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:27:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f6daf-c78c-449e-9a1a-ec72912bd0d6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:44 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD
Sep 24 18:27:44 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:27:45 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD" returned: 0 in 1.956s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106134831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d19cf67-fa08-40ee-ae37-bd004e412dd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5779e7e7b29f4782ad4aaf1161cae1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:40Z,use_quota=True,user_id='9e5793942b7c454d8d7a45cf2b80b698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Creating volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:45 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:27:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:45 devstack quobyte-client[84528]: System call of process 101587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:45 devstack quobyte-client[84528]: System call of process 101587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:45 devstack quobyte-client[84528]: System call of process 101587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:45 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=137, name=volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 1073741824" returned: 0 in 0.417s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Attempting download of a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269b8ac-d4cc-4eb4-808f-b32ac266f337]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_y6upgb6l {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_y6upgb6l" returned: 0 in 0.336s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_y6upgb6l {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_y6upgb6l" returned: 1 in 0.344s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a414f1aa-0123-4732-9dda-73666cba7ecf_y6upgb6l' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b0b0d4-9eee-4e6e-9395-6da47f72134d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] a414f1aa-0123-4732-9dda-73666cba7ecf was qcow2, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:27:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:47 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=137, name=volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:27:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 1.103s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:48 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a414f1aa-0123-4732-9dda-73666cba7ecf_6xmjr0cbdevstack@QuobyteHD, size 112.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:27:48 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Converted 112.00 MB image at 99.36 MB/s
Sep 24 18:27:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:49 devstack quobyte-client[84528]: System call of process 101604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 1G" returned: 0 in 0.154s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[000c5bf8-6591-4d1a-b67c-981bc57c0211]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.399s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:50 devstack quobyte-client[84528]: System call of process 101615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:50 devstack quobyte-client[84528]: System call of process 101615 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 1 in 0.545s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Downloaded image a414f1aa-0123-4732-9dda-73666cba7ecf ((None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}])) to volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Temporary image a414f1aa-0123-4732-9dda-73666cba7ecf for user 9e5793942b7c454d8d7a45cf2b80b698 is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Marking volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Copying metadata from image a414f1aa-0123-4732-9dda-73666cba7ecf to 9d19cf67-fa08-40ee-ae37-bd004e412dd5. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Creating volume glance metadata for volume 9d19cf67-fa08-40ee-ae37-bd004e412dd5 backed by image a414f1aa-0123-4732-9dda-73666cba7ecf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2a0db6-1250-4f54-a224-7fdf96fb6010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'volume_size': 1, 'image_id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a414f1aa-0123-4732-9dda-73666cba7ecf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '149bece265c74054b1986b8105f2e41f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a414f1aa-0123-4732-9dda-73666cba7ecf', 'created_at': datetime.datetime(2025, 9, 24, 15, 30, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 15, 30, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a414f1aa-0123-4732-9dda-73666cba7ecf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b863ea260>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b28c628-ad86-4a7a-a154-66d0bb2a81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:50 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Volume volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 (9d19cf67-fa08-40ee-ae37-bd004e412dd5): created successfully
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b28c628-ad86-4a7a-a154-66d0bb2a81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:50 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Flow 'volume_create_manager' (17f35509-a666-4cfb-8e35-a0286deb71ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:50 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-2842df72-1252-443c-93fe-261efe43df71 tempest-TestShelveInstance-1733813307 None] Created volume successfully.
Sep 24 18:28:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=15,cinder:INSERT=12,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[541d9c51-9e7b-48be-86a9-17f8e32e16c9]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:01 devstack quobyte-client[84528]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:01 devstack quobyte-client[84528]: System call of process 101656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.527s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:02 devstack quobyte-client[84528]: System call of process 101663 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 1 in 0.439s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:28:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:02 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2e71de3-4158-4df6-9b10-0e388784ebba', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:28:02 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-e668bf78-acbc-4578-b2a5-108750a1bb44 req-cdf0fc7e-8f89-490a-9011-9cec067b2e30 tempest-TestShelveInstance-1733813307 None] attachment_update completed successfully.
Sep 24 18:28:12 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:12 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.082s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-96215190-2fa1-4ea6-9507-e35fb257ffde req-45a59948-9904-4792-861c-877f1706d953 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-96215190-2fa1-4ea6-9507-e35fb257ffde req-45a59948-9904-4792-861c-877f1706d953 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-96215190-2fa1-4ea6-9507-e35fb257ffde req-45a59948-9904-4792-861c-877f1706d953 tempest-TestShelveInstance-1733813307 None] Terminate volume connection completed successfully.
Sep 24 18:29:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-96215190-2fa1-4ea6-9507-e35fb257ffde req-45a59948-9904-4792-861c-877f1706d953 tempest-TestShelveInstance-1733813307 None] Deleting attachment e2e71de3-4158-4df6-9b10-0e388784ebba. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29acf22-b6e7-4165-8e2a-3e78736bbe56]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:39 devstack quobyte-client[84528]: System call of process 102297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:39 devstack quobyte-client[84528]: System call of process 102297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:39 devstack quobyte-client[84528]: System call of process 102297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.453s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:40 devstack quobyte-client[84528]: System call of process 102299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 1 in 0.387s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:29:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2', 'name': 'volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28f0b7df-7eae-42ed-818c-38c63681d6e8', 'enforce_multipath': True} {{(pid=84502) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:29:40 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-d66e097e-6dba-424e-9cda-df8c15e7a29f req-447fe5d6-b7ed-40d2-82d8-4400fe9d0c78 tempest-TestShelveInstance-1733813307 None] attachment_update completed successfully.
Sep 24 18:29:50 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:29:50 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-dff8698f-d182-4166-8b42-22119ce87f06 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-dff8698f-d182-4166-8b42-22119ce87f06 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-dff8698f-d182-4166-8b42-22119ce87f06 tempest-TestShelveInstance-1733813307 None] Terminate volume connection completed successfully.
Sep 24 18:31:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-dff8698f-d182-4166-8b42-22119ce87f06 tempest-TestShelveInstance-1733813307 None] Deleting attachment 28f0b7df-7eae-42ed-818c-38c63681d6e8. {{(pid=84502) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Acquiring lock "cinder-9d19cf67-fa08-40ee-ae37-bd004e412dd5-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "cinder-9d19cf67-fa08-40ee-ae37-bd004e412dd5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Acquiring lock "cinder-quobyte-9d19cf67-fa08-40ee-ae37-bd004e412dd5" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "cinder-quobyte-9d19cf67-fa08-40ee-ae37-bd004e412dd5" acquired by "delete_volume" :: waited 0.017s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[35583be8-ec55-47eb-ab37-8e18dab63a8a]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.438s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 1 in 0.375s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9d19cf67-fa08-40ee-ae37-bd004e412dd5" returned: 0 in 0.100s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:13 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "cinder-quobyte-9d19cf67-fa08-40ee-ae37-bd004e412dd5" released by "delete_volume" :: held 1.247s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG cinder.quota [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Created reservations ['10007a75-08f3-400a-8170-1332e122c25a', 'a6745597-84c7-4eab-ab6e-67eea31ba462', 'e45c4921-147f-4508-9f48-a1bd59f93e4d', '31389392-262b-45a4-bfdb-4bbfb2be90ad'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG cinder.manager [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Deleted volume successfully.
Sep 24 18:31:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [req-c004cd41-2257-4758-8a71-d539f5ce1284 req-2170827d-9e2b-4a47-9f16-f968dcf43862 tempest-TestShelveInstance-1733813307 None] Lock "cinder-9d19cf67-fa08-40ee-ae37-bd004e412dd5-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.105s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:24 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:24 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Flow 'volume_create_manager' (8d10f00c-e655-4f26-a9df-d1a8caf418fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af2dd82-1cdb-4e7d-9c25-1d0a4f1056c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af2dd82-1cdb-4e7d-9c25-1d0a4f1056c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45563bb1-8a92-4ffd-84be-f3db713ff238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebdacf19340878b49312a40883f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:31Z,use_quota=True,user_id='e477469994d4488494151636b82a32d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84072858-5d5d-47ba-a6e7-055d41b3bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84072858-5d5d-47ba-a6e7-055d41b3bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af82f05e-52ed-496f-a03e-ffe048ac5910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af82f05e-52ed-496f-a03e-ffe048ac5910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45563bb1-8a92-4ffd-84be-f3db713ff238', 'volume_name': 'volume-45563bb1-8a92-4ffd-84be-f3db713ff238', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eadb770-cce4-4040-8e25-baf39d42a02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eadb770-cce4-4040-8e25-baf39d42a02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c64b916-7714-405b-a3de-f4893cfb6bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:31 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Volume 45563bb1-8a92-4ffd-84be-f3db713ff238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45563bb1-8a92-4ffd-84be-f3db713ff238', 'volume_size': 1}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45563bb1-8a92-4ffd-84be-f3db713ff238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebdacf19340878b49312a40883f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:31Z,use_quota=True,user_id='e477469994d4488494151636b82a32d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Creating volume 45563bb1-8a92-4ffd-84be-f3db713ff238 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:31 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:31:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:31 devstack quobyte-client[84528]: System call of process 102970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:31 devstack quobyte-client[84528]: System call of process 102970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:31 devstack quobyte-client[84528]: System call of process 102970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:31 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=138, name=volume-45563bb1-8a92-4ffd-84be-f3db713ff238, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238 1073741824" returned: 0 in 0.511s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238" returned: 0 in 0.167s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] <== create_volume: return (785ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c64b916-7714-405b-a3de-f4893cfb6bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45563bb1-8a92-4ffd-84be-f3db713ff238', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e661418b-e4e9-4fc3-8965-264458d077d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:32 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Volume volume-45563bb1-8a92-4ffd-84be-f3db713ff238 (45563bb1-8a92-4ffd-84be-f3db713ff238): created successfully
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e661418b-e4e9-4fc3-8965-264458d077d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Flow 'volume_create_manager' (8d10f00c-e655-4f26-a9df-d1a8caf418fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8487801c-b262-45a4-8564-3b3b3a584cbb tempest-CinderUnicodeTest-1067739441 None] Created volume successfully.
Sep 24 18:31:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Flow 'volume_create_manager' (e171d074-ed8b-45af-8c4d-699224f94b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c5f284-956f-4228-b262-931946eb6a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c5f284-956f-4228-b262-931946eb6a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1120917512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97ca79-bca9-438f-8046-657efd252616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebdacf19340878b49312a40883f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:34Z,use_quota=True,user_id='e477469994d4488494151636b82a32d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61a578-9355-4947-aa6e-8af5759374ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f61a578-9355-4947-aa6e-8af5759374ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae019646-df29-4749-b483-5f9eb56b9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae019646-df29-4749-b483-5f9eb56b9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c97ca79-bca9-438f-8046-657efd252616', 'volume_name': 'volume-0c97ca79-bca9-438f-8046-657efd252616', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28fde07-1b71-4a42-95bb-82f4d74bf4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28fde07-1b71-4a42-95bb-82f4d74bf4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca511d-0097-4e58-941b-6f80f159309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:34 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Volume 0c97ca79-bca9-438f-8046-657efd252616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c97ca79-bca9-438f-8046-657efd252616', 'volume_size': 1}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1120917512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97ca79-bca9-438f-8046-657efd252616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ceebdacf19340878b49312a40883f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:34Z,use_quota=True,user_id='e477469994d4488494151636b82a32d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Creating volume 0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:34 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:34 devstack quobyte-client[84528]: System call of process 102975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:34 devstack quobyte-client[84528]: System call of process 102975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:34 devstack quobyte-client[84528]: System call of process 102975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:34 devstack quobyte-client[84528]: System call of process 102975 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:34 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=139, name=volume-0c97ca79-bca9-438f-8046-657efd252616, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 1073741824" returned: 0 in 0.384s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616" returned: 0 in 0.119s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] <== create_volume: return (575ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ca511d-0097-4e58-941b-6f80f159309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c97ca79-bca9-438f-8046-657efd252616', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec27c5c7-3085-4ecb-a213-9afc9d31d6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:34 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Volume volume-0c97ca79-bca9-438f-8046-657efd252616 (0c97ca79-bca9-438f-8046-657efd252616): created successfully
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec27c5c7-3085-4ecb-a213-9afc9d31d6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Flow 'volume_create_manager' (e171d074-ed8b-45af-8c4d-699224f94b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:34 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-259daf6b-997a-4a06-a416-783eead3c362 tempest-CinderUnicodeTest-1067739441 None] Created volume successfully.
Sep 24 18:31:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Creating offline snapshot c7db26c0-9d02-4e8a-8844-ecb26dd631be of volume 0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[33523d5a-0efe-4634-9386-338cead9e3f4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616" returned: 0 in 0.431s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=140, name=volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be 1G" returned: 0 in 0.276s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0c97ca79-bca9-438f-8046-657efd252616 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack quobyte-client[84528]: System call of process 102986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "qemu-img rebase -u -b volume-0c97ca79-bca9-438f-8046-657efd252616 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.144s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.087s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.info" returned: 0 in 0.102s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:31:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.info" returned: 0 in 0.088s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.613s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:38 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f71fb777-2175-4fe9-aaee-077daba97a35 tempest-CinderUnicodeTest-1067739441 None] Create snapshot completed successfully
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-c7db26c0-9d02-4e8a-8844-ecb26dd631be-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-c7db26c0-9d02-4e8a-8844-ecb26dd631be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-quobyte-c7db26c0-9d02-4e8a-8844-ecb26dd631be" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-c7db26c0-9d02-4e8a-8844-ecb26dd631be" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Deleting offline snapshot c7db26c0-9d02-4e8a-8844-ecb26dd631be of volume 0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] snapshot_file for this snap is: volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b3959-753c-4358-95d3-3c2810ad60d1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.393s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c97ca79-bca9-438f-8046-657efd252616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc821db0-6a9d-48b2-992a-559eda46d109]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:39 devstack quobyte-client[84528]: System call of process 102996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616" returned: 0 in 0.436s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:39 devstack quobyte-client[84528]: System call of process 102999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.270s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616.c7db26c0-9d02-4e8a-8844-ecb26dd631be" returned: 0 in 0.091s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-c7db26c0-9d02-4e8a-8844-ecb26dd631be" released by "_delete_snapshot" :: held 1.522s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" released by "delete_snapshot" :: held 1.555s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Created reservations ['7026d8e7-76ac-4c1f-8802-4a1cca354b6e', '625b6728-ad07-4b71-9654-31194ef62d30', 'a8c968d7-256d-4169-bf80-553e6e2056ef', '73d786bd-b896-4fd6-b237-ac0877f7a479'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:40 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Delete snapshot completed successfully.
Sep 24 18:31:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ab57223d-b074-4f4f-9ce1-8cfc5d3c428f tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-c7db26c0-9d02-4e8a-8844-ecb26dd631be-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-0c97ca79-bca9-438f-8046-657efd252616-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-0c97ca79-bca9-438f-8046-657efd252616-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:41 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f677e69-d47a-48cd-9341-499f88d50c51]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616" returned: 0 in 0.423s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-0c97ca79-bca9-438f-8046-657efd252616" returned: 0 in 0.111s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-0c97ca79-bca9-438f-8046-657efd252616" released by "delete_volume" :: held 0.738s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Created reservations ['3b5c17df-6274-4751-aa0c-0e66221cef24', '5286a29c-5940-4365-98e3-0d953c96e431', 'f3c9328a-6a61-44bd-854d-5f2db9607ea0', 'fb1e4067-64f2-4ba6-b8b9-ccd44dc9ad44'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.100s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Deleted volume successfully.
Sep 24 18:31:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-759763fc-54ec-4a23-98c4-ae23363dd00b tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-0c97ca79-bca9-438f-8046-657efd252616-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-45563bb1-8a92-4ffd-84be-f3db713ff238-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-45563bb1-8a92-4ffd-84be-f3db713ff238-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "cinder-quobyte-45563bb1-8a92-4ffd-84be-f3db713ff238" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-45563bb1-8a92-4ffd-84be-f3db713ff238" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf102f6-2dc9-45fe-b996-5b7ae7504c43]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238" returned: 0 in 0.446s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-45563bb1-8a92-4ffd-84be-f3db713ff238" returned: 0 in 0.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-quobyte-45563bb1-8a92-4ffd-84be-f3db713ff238" released by "delete_volume" :: held 0.726s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Created reservations ['cf062544-4181-4ae0-8639-1aafea0f7b3b', 'cf0e3ce4-00c3-495b-a284-fab4d9725346', '2c10be82-041b-450e-a408-2a6fd435e1d1', '3555017c-4915-4e47-b8b7-c203c78d43af'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.098s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:45 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Deleted volume successfully.
Sep 24 18:31:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-d7ad2a3c-81d8-403f-ae90-28489e0df3c7 tempest-CinderUnicodeTest-1067739441 None] Lock "cinder-45563bb1-8a92-4ffd-84be-f3db713ff238-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:55 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=21,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:55 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=28,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=6 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:12 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Flow 'volume_create_manager' (ddfcc972-ce84-4072-9fdd-c098f9a68604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427282ae-35c3-4565-94ea-4f3e627949c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427282ae-35c3-4565-94ea-4f3e627949c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1270780396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4317e1ae-dbee-4ee2-886f-aae992842e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd67305ae649e2aeb3319b1e1955f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:12Z,use_quota=True,user_id='94bfdf766c724b72b2d12227623c5706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73a4e7-ae14-408d-a9fd-33dbe44b6250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73a4e7-ae14-408d-a9fd-33dbe44b6250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be823bec-31ad-48f0-bad2-b46535dfc47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be823bec-31ad-48f0-bad2-b46535dfc47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4317e1ae-dbee-4ee2-886f-aae992842e95', 'volume_name': 'volume-4317e1ae-dbee-4ee2-886f-aae992842e95', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8377448a-447e-4252-8cde-b896ca6f5ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8377448a-447e-4252-8cde-b896ca6f5ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fac87c-62f0-43f3-bccf-c4fae2cfbe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:12 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Volume 4317e1ae-dbee-4ee2-886f-aae992842e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4317e1ae-dbee-4ee2-886f-aae992842e95', 'volume_size': 1}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1270780396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4317e1ae-dbee-4ee2-886f-aae992842e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd67305ae649e2aeb3319b1e1955f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:12Z,use_quota=True,user_id='94bfdf766c724b72b2d12227623c5706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Creating volume 4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:32:12 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:32:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:12 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=142, name=volume-4317e1ae-dbee-4ee2-886f-aae992842e95, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 1073741824" returned: 0 in 0.382s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.095s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] <== create_volume: return (551ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.562s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fac87c-62f0-43f3-bccf-c4fae2cfbe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4317e1ae-dbee-4ee2-886f-aae992842e95', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2456c9-a4b0-47e1-bd02-32363b5292f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:13 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Volume volume-4317e1ae-dbee-4ee2-886f-aae992842e95 (4317e1ae-dbee-4ee2-886f-aae992842e95): created successfully
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2456c9-a4b0-47e1-bd02-32363b5292f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Flow 'volume_create_manager' (ddfcc972-ce84-4072-9fdd-c098f9a68604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-444452d5-5dd5-467c-9b0b-bda3b36801c7 tempest-SnapshotDependencyTests-95045919 None] Created volume successfully.
Sep 24 18:32:14 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Creating offline snapshot e3a07b8f-4e12-473e-9a08-6e73482139ac of volume 4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b10893-6266-41c0-8d1a-1e286de4aad2]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.447s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:15 devstack quobyte-client[84528]: System call of process 103064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:15 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=143, name=volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac 1G" returned: 0 in 0.282s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4317e1ae-dbee-4ee2-886f-aae992842e95 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "qemu-img rebase -u -b volume-4317e1ae-dbee-4ee2-886f-aae992842e95 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.144s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.083s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.131s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.info" returned: 0 in 0.114s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.info" returned: 0 in 0.093s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.661s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9d3a2953-83bd-4a2a-a6eb-f93f7f4dc5a3 tempest-SnapshotDependencyTests-95045919 None] Create snapshot completed successfully
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.094s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:18 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Flow 'volume_create_manager' (1696cffc-6d68-43ba-a9a6-43509bf806a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db908f5-527e-4cc1-8b13-2adc1d7ad575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db908f5-527e-4cc1-8b13-2adc1d7ad575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23468d7f-c636-4dd4-9812-387ce374f00c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd67305ae649e2aeb3319b1e1955f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3a07b8f-4e12-473e-9a08-6e73482139ac,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:18Z,use_quota=True,user_id='94bfdf766c724b72b2d12227623c5706',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a412ae-f455-4033-92a9-05516b92167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a412ae-f455-4033-92a9-05516b92167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cbcf0c-5c8a-4dcc-8a2b-70d03b99db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cbcf0c-5c8a-4dcc-8a2b-70d03b99db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23468d7f-c636-4dd4-9812-387ce374f00c', 'volume_name': 'volume-23468d7f-c636-4dd4-9812-387ce374f00c', 'volume_size': 1, 'snapshot_id': 'e3a07b8f-4e12-473e-9a08-6e73482139ac'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206882d4-7da1-48d7-82a5-da7e41aede11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206882d4-7da1-48d7-82a5-da7e41aede11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa63567-fe93-4b05-b63c-2c2585327d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:18 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Volume 23468d7f-c636-4dd4-9812-387ce374f00c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23468d7f-c636-4dd4-9812-387ce374f00c', 'volume_size': 1, 'snapshot_id': 'e3a07b8f-4e12-473e-9a08-6e73482139ac'}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac-23468d7f-c636-4dd4-9812-387ce374f00c" by "_create_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac-23468d7f-c636-4dd4-9812-387ce374f00c" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Creating volume 23468d7f-c636-4dd4-9812-387ce374f00c from snapshot e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" by "_copy_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] snapshot: e3a07b8f-4e12-473e-9a08-6e73482139ac, volume: 23468d7f-c636-4dd4-9812-387ce374f00c,  {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[418843a8-d121-4d1d-bec6-4cbbbe5f33fe]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:19 devstack quobyte-client[84528]: System call of process 103075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.392s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4317e1ae-dbee-4ee2-886f-aae992842e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Creating direct copy from snapshot {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec24332f-978b-4ed8-be8f-574674bcacfe]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.426s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:20 devstack cinder-volume[84502]: DEBUG cinder.utils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c not found in is_blk_device check {{(pid=84502) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:32:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:20 devstack quobyte-client[84528]: System call of process 103081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:20 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=145, name=volume-23468d7f-c636-4dd4-9812-387ce374f00c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:32:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c" returned: 0 in 5.919s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5e9de3-487a-4d21-9873-785a6d012ba1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.544s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:32:26 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Converted 1024.00 MB image at 172.17 MB/s
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c" returned: 0 in 0.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" released by "_copy_volume_from_snapshot" :: held 7.801s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac-23468d7f-c636-4dd4-9812-387ce374f00c" released by "_create_volume_from_snapshot" :: held 7.855s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.877s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa63567-fe93-4b05-b63c-2c2585327d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23468d7f-c636-4dd4-9812-387ce374f00c', 'volume_size': 1, 'snapshot_id': 'e3a07b8f-4e12-473e-9a08-6e73482139ac'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b98567-9c49-41f7-b55e-f3bbf1ec0e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Volume volume-23468d7f-c636-4dd4-9812-387ce374f00c (23468d7f-c636-4dd4-9812-387ce374f00c): created successfully
Sep 24 18:32:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b98567-9c49-41f7-b55e-f3bbf1ec0e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Flow 'volume_create_manager' (1696cffc-6d68-43ba-a9a6-43509bf806a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:27 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-48b594d7-033f-40cd-b497-69975fdc0236 tempest-SnapshotDependencyTests-95045919 None] Created volume successfully.
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-e3a07b8f-4e12-473e-9a08-6e73482139ac-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-e3a07b8f-4e12-473e-9a08-6e73482139ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:28 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Deleting offline snapshot e3a07b8f-4e12-473e-9a08-6e73482139ac of volume 4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] snapshot_file for this snap is: volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[638da4d6-e35c-4744-a7fe-4c945b5c39a4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:28 devstack quobyte-client[84528]: System call of process 103099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.424s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4317e1ae-dbee-4ee2-886f-aae992842e95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[c610478a-ef16-4061-9d04-7741272055bb]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:29 devstack quobyte-client[84528]: System call of process 103102 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.396s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.240s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95.e3a07b8f-4e12-473e-9a08-6e73482139ac" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-e3a07b8f-4e12-473e-9a08-6e73482139ac" released by "_delete_snapshot" :: held 1.478s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" released by "delete_snapshot" :: held 1.506s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:29 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Created reservations ['8bb7fa71-b1e3-444d-8228-758612b756c2', 'be367884-897f-42f3-8252-66b8e5a4ee00', '28f7daea-778e-4d6e-8496-2763f37cdd2f', '41fa5d89-68a2-4125-b1ec-0f1a0df2d411'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Delete snapshot completed successfully.
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f56c38b4-a422-4f15-8f7e-13a3c4ff8e85 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-e3a07b8f-4e12-473e-9a08-6e73482139ac-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-4317e1ae-dbee-4ee2-886f-aae992842e95-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-4317e1ae-dbee-4ee2-886f-aae992842e95-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:30 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" acquired by "delete_volume" :: waited 0.019s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e85b9d-a3c5-416d-9326-bd036f06b6f5]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:30 devstack quobyte-client[84528]: System call of process 103109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:30 devstack quobyte-client[84528]: System call of process 103109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:30 devstack quobyte-client[84528]: System call of process 103109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.409s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-4317e1ae-dbee-4ee2-886f-aae992842e95" returned: 0 in 0.092s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-4317e1ae-dbee-4ee2-886f-aae992842e95" released by "delete_volume" :: held 0.688s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Created reservations ['abc3a0b1-f8cd-46e3-82bc-00431a8e6a43', '6f027197-c213-4b79-86f8-cf74109ca588', '1506b4fe-21e5-438f-99c6-854eedeaf34e', '6d656cb2-f92c-47c3-b458-868c063c659d'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.124s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:31 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Deleted volume successfully.
Sep 24 18:32:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-dd432fe3-9512-4651-9e61-3fd57a5637d6 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-4317e1ae-dbee-4ee2-886f-aae992842e95-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-23468d7f-c636-4dd4-9812-387ce374f00c-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-23468d7f-c636-4dd4-9812-387ce374f00c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" acquired by "delete_volume" :: waited 0.020s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f79d3d-c11c-47f3-93af-905772d6ff32]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:33 devstack quobyte-client[84528]: System call of process 103115 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c" returned: 0 in 0.576s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-23468d7f-c636-4dd4-9812-387ce374f00c" returned: 0 in 0.112s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-quobyte-23468d7f-c636-4dd4-9812-387ce374f00c" released by "delete_volume" :: held 1.032s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Created reservations ['cbbd789e-ac1c-439b-8da8-7053d7c4d7cb', 'b8e83e29-f934-48aa-aaab-845a4483db0e', '7044782b-01a8-49d6-8aaf-5a0316e8897d', 'ee536335-8fb3-40de-8339-9fca9c1946e9'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.140s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:35 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:35 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Deleted volume successfully.
Sep 24 18:32:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f63e7d54-9e57-4ee9-891e-5796e3e80362 tempest-SnapshotDependencyTests-95045919 None] Lock "cinder-23468d7f-c636-4dd4-9812-387ce374f00c-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:44 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:45 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=34,cinder:DELETE=3,cinder:SELECT=20,cinder:INSERT=7 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:00 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=1 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:06 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (4aee94e0-9e0c-4d81-8005-bddb43ac55d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fd7da3-64d1-446f-929a-ae866977fc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fd7da3-64d1-446f-929a-ae866977fc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687897137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49452c-4609-440e-8e6c-ff61c686cecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:06Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20205949-39a3-4770-9cd3-99dd35501b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20205949-39a3-4770-9cd3-99dd35501b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546fbf72-28b9-457f-951f-a190cc26257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546fbf72-28b9-457f-951f-a190cc26257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c49452c-4609-440e-8e6c-ff61c686cecd', 'volume_name': 'volume-7c49452c-4609-440e-8e6c-ff61c686cecd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634b3486-9c71-4830-95c2-29e6a46ab061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634b3486-9c71-4830-95c2-29e6a46ab061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5be3685-e2c0-4d6e-bf85-6aa3cd906348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:06 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume 7c49452c-4609-440e-8e6c-ff61c686cecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c49452c-4609-440e-8e6c-ff61c686cecd', 'volume_size': 1}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-687897137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49452c-4609-440e-8e6c-ff61c686cecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:06Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume 7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:06 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:07 devstack quobyte-client[84528]: System call of process 103212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:07 devstack quobyte-client[84528]: System call of process 103212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:07 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=146, name=volume-7c49452c-4609-440e-8e6c-ff61c686cecd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (c5b3d4ef-8f29-472e-a1fa-28366b368967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f225055a-5353-48f2-acb1-769cff1e07f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f225055a-5353-48f2-acb1-769cff1e07f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066871057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:06Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8256b3ec-16c7-4171-a468-419bbb8352bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8256b3ec-16c7-4171-a468-419bbb8352bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d72f11a-ce02-45ae-bb0f-8b0d5884d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d72f11a-ce02-45ae-bb0f-8b0d5884d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f', 'volume_name': 'volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca163344-52e1-45df-8f3a-75e336990b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca163344-52e1-45df-8f3a-75e336990b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb8df4-32b1-4d77-9bc9-c2635910091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Volume a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f', 'volume_size': 1}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd 1073741824" returned: 0 in 0.943s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (7721cfa4-e1cb-4b1b-913f-59366f1cafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace565f-8be5-49f8-a5b6-87c2e80b7f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eace565f-8be5-49f8-a5b6-87c2e80b7f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139111841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edccf0be-b40c-4dbc-ac52-bb32c8a07c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:07Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ddb2b4-3f4f-4f9a-84ba-3938b59bec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ddb2b4-3f4f-4f9a-84ba-3938b59bec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4e7dce-8548-4893-a623-97c32b52703b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4e7dce-8548-4893-a623-97c32b52703b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edccf0be-b40c-4dbc-ac52-bb32c8a07c59', 'volume_name': 'volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00153fd-0582-463e-a3c5-129690156f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00153fd-0582-463e-a3c5-129690156f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351e52c7-17bb-4bf5-b1ff-940169597f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:08 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Volume edccf0be-b40c-4dbc-ac52-bb32c8a07c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59', 'volume_size': 1}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (b4e7d25c-a8c5-427b-a8f0-4c6245b77e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba33828-83bb-4e8f-aac3-6e62ee980f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd" returned: 0 in 0.877s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (1913ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2066871057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:06Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Creating volume a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:08 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:08 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=147, name=volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (719b12da-4eec-471c-94de-912e6144fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28624b62-b39e-46a1-a99d-623aace8dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba33828-83bb-4e8f-aac3-6e62ee980f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585383372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117c7583-254a-4f21-a08c-8934830f6a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:07Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb50705-9f62-4c94-926f-27416ea33115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb50705-9f62-4c94-926f-27416ea33115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b32298-57ac-4431-82d4-f9a821fd1c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b32298-57ac-4431-82d4-f9a821fd1c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117c7583-254a-4f21-a08c-8934830f6a08', 'volume_name': 'volume-117c7583-254a-4f21-a08c-8934830f6a08', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fca3e2f-35f2-4065-82d9-04460413b343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fca3e2f-35f2-4065-82d9-04460413b343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ed592-b621-46ae-941a-02c5cb4869cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Volume 117c7583-254a-4f21-a08c-8934830f6a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117c7583-254a-4f21-a08c-8934830f6a08', 'volume_size': 1}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28624b62-b39e-46a1-a99d-623aace8dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226252337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f685d0-5a7a-453c-8141-a104ea60c1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:08Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08babd9a-3afa-4263-914a-f4cdc3520eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08babd9a-3afa-4263-914a-f4cdc3520eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7e761b-2b8b-46d0-b1c6-64b7a0ef2e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7e761b-2b8b-46d0-b1c6-64b7a0ef2e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f685d0-5a7a-453c-8141-a104ea60c1f7', 'volume_name': 'volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1337992d-c355-4c54-a861-070257deef41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1337992d-c355-4c54-a861-070257deef41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b7196a-3952-4234-a49f-5dceeb6f3d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Volume e2f685d0-5a7a-453c-8141-a104ea60c1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7', 'volume_size': 1}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5be3685-e2c0-4d6e-bf85-6aa3cd906348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c49452c-4609-440e-8e6c-ff61c686cecd', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc4156d-e4af-4739-a1a7-093d40815353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f 1073741824" returned: 0 in 0.727s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-7c49452c-4609-440e-8e6c-ff61c686cecd (7c49452c-4609-440e-8e6c-ff61c686cecd): created successfully
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc4156d-e4af-4739-a1a7-093d40815353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (4aee94e0-9e0c-4d81-8005-bddb43ac55d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (165ff09a-99fc-46c2-ba8f-2a03f4f7d2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2090e3a-0697-4b95-8d88-356797c1d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:09 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-af8219de-8d0f-4e71-99ef-85ef2f5dbbfe tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" returned: 0 in 0.559s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] <== create_volume: return (1308ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139111841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edccf0be-b40c-4dbc-ac52-bb32c8a07c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:07Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Creating volume edccf0be-b40c-4dbc-ac52-bb32c8a07c59 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:10 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2090e3a-0697-4b95-8d88-356797c1d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1533305289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:09Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:10 devstack quobyte-client[84528]: System call of process 103221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:10 devstack quobyte-client[84528]: System call of process 103221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:10 devstack quobyte-client[84528]: System call of process 103221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:10 devstack quobyte-client[84528]: System call of process 103221 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e45c995-b9ab-4194-91e7-17fbd22d4885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e45c995-b9ab-4194-91e7-17fbd22d4885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362b225e-971e-483d-8051-188c1c2b1364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362b225e-971e-483d-8051-188c1c2b1364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e', 'volume_name': 'volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecb28e5-110b-431c-9b2b-6b6ee1c0ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:10 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=148, name=volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecb28e5-110b-431c-9b2b-6b6ee1c0ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959f26fb-1ec4-4194-bdd4-253d87909fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Volume 1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e', 'volume_size': 1}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bb8df4-32b1-4d77-9bc9-c2635910091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2660705-aa2e-4d78-b831-e6deff143b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 1073741824" returned: 0 in 0.647s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Flow 'volume_create_manager' (e2c27ab4-6477-4916-9514-4babf24f8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b800cd-3d1f-4cf3-96b1-b530b66c787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Volume volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f (a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f): created successfully
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2660705-aa2e-4d78-b831-e6deff143b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (c5b3d4ef-8f29-472e-a1fa-28366b368967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b800cd-3d1f-4cf3-96b1-b530b66c787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4d0cb7-20bd-4f03-b906-c6a97c0a9314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e87b2c86fe48b29907c78f943d32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:10Z,use_quota=True,user_id='ec9f11c0cd154027a59a15ea854f9aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5329bc-1a7f-4e51-b10b-d11cd5857980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5329bc-1a7f-4e51-b10b-d11cd5857980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5706d99e-a43c-4e8b-886a-90ef32e91d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.image.glance [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Creating Keystone auth plugin from conf {{(pid=84502) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" returned: 0 in 0.597s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] <== create_volume: return (1288ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.972s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585383372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117c7583-254a-4f21-a08c-8934830f6a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:07Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Creating volume 117c7583-254a-4f21-a08c-8934830f6a08 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:11 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:11 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=149, name=volume-117c7583-254a-4f21-a08c-8934830f6a08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351e52c7-17bb-4bf5-b1ff-940169597f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e4031f-cdf8-4c61-b4ea-031606d768c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:11 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-284c42c9-4e5e-4e74-a2bd-1f2e667da06e tempest-CreateVolumesFromImageTest-1895715617 None] Created volume successfully.
Sep 24 18:33:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Volume volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 (edccf0be-b40c-4dbc-ac52-bb32c8a07c59): created successfully
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e4031f-cdf8-4c61-b4ea-031606d768c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (7721cfa4-e1cb-4b1b-913f-59366f1cafa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08 1073741824" returned: 0 in 0.552s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1daeb6ba-1a77-4323-a032-ff67b63f322f tempest-CreateVolumesFromImageTest-1895715617 None] Created volume successfully.
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08" returned: 0 in 0.414s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] <== create_volume: return (1003ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.970s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1226252337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f685d0-5a7a-453c-8141-a104ea60c1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:08Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Creating volume e2f685d0-5a7a-453c-8141-a104ea60c1f7 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:12 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:12 devstack quobyte-client[84528]: System call of process 103229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:12 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=150, name=volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748ed592-b621-46ae-941a-02c5cb4869cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117c7583-254a-4f21-a08c-8934830f6a08', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1809bb3d-59a7-488c-89cb-1c2aff82f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 1073741824" returned: 0 in 0.510s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5706d99e-a43c-4e8b-886a-90ef32e91d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b4d0cb7-20bd-4f03-b906-c6a97c0a9314', 'volume_name': 'volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314', 'volume_size': 1, 'image_id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bc0bea5ab1a85ccce0c1b0af949f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35e87b2c86fe48b29907c78f943d32ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97d1e5339823f2b7d073a03f001e19271f8f839d66d3b1de1af25b0863142fa8569e214cd0a1f633233be5b4b907ae1c9fad3b52a6503961ba1b70264657d980', 'id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'created_at': datetime.datetime(2025, 9, 24, 16, 33, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 33, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c47935a4-d017-4be4-84d8-7e6a60df0146/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b866c9990>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2fdd4-1d28-46f0-91d4-54b22c9d5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2fdd4-1d28-46f0-91d4-54b22c9d5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a767ac72-e1a5-4403-9b95-976f76d71a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:13 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314', 'volume_size': 1, 'image_id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bc0bea5ab1a85ccce0c1b0af949f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35e87b2c86fe48b29907c78f943d32ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97d1e5339823f2b7d073a03f001e19271f8f839d66d3b1de1af25b0863142fa8569e214cd0a1f633233be5b4b907ae1c9fad3b52a6503961ba1b70264657d980', 'id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'created_at': datetime.datetime(2025, 9, 24, 16, 33, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 33, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c47935a4-d017-4be4-84d8-7e6a60df0146/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b866c9990>}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Cloning 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 from image c47935a4-d017-4be4-84d8-7e6a60df0146  at location (None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}]). {{(pid=84502) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:33:13 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Volume volume-117c7583-254a-4f21-a08c-8934830f6a08 (117c7583-254a-4f21-a08c-8934830f6a08): created successfully
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1809bb3d-59a7-488c-89cb-1c2aff82f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (b4e7d25c-a8c5-427b-a8f0-4c6245b77e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7" returned: 0 in 0.473s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] <== create_volume: return (1011ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.037s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1533305289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7750aad7830f4317873210115a07dea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:09Z,use_quota=True,user_id='4cc5fdd4a6f04cad815a6289a06718b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Creating volume 1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:13 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:13 devstack quobyte-client[84528]: System call of process 103233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:13 devstack quobyte-client[84528]: System call of process 103233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:13 devstack quobyte-client[84528]: System call of process 103233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:13 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=151, name=volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6613ecfd-0c30-47c6-b08c-115131048b71 tempest-CreateVolumesFromImageTest-1895715617 None] Created volume successfully.
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:33:13 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Image download 0.00 MB at 0.00 MB/s
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b7196a-3952-4234-a49f-5dceeb6f3d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85814cc-221f-4c0f-9321-b099cf706944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e 1073741824" returned: 0 in 0.554s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:14 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Volume volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 (e2f685d0-5a7a-453c-8141-a104ea60c1f7): created successfully
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85814cc-221f-4c0f-9321-b099cf706944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (719b12da-4eec-471c-94de-912e6144fac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" returned: 0 in 0.485s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] <== create_volume: return (1075ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[255bda5e-ee7e-4b11-84e2-c1163937184a]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.643s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-75745551-3336-4811-bf08-edd17d105180 tempest-CreateVolumesFromImageTest-1895715617 None] Created volume successfully.
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959f26fb-1ec4-4194-bdd4-253d87909fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207f97cf-4e2b-4515-a962-e379443cceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating offline snapshot a3e22f7e-d6ac-403c-bcf8-518436818ac9 of volume 7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c947c0-7f6a-4781-9252-5cf15dd3d81f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:15 devstack sudo[103237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD
Sep 24 18:33:15 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:33:15 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Volume volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e (1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e): created successfully
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207f97cf-4e2b-4515-a962-e379443cceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Flow 'volume_create_manager' (165ff09a-99fc-46c2-ba8f-2a03f4f7d2a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:15 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-d6ede78a-f19d-4ea2-9ef2-23bce980d75f tempest-CreateVolumesFromImageTest-1895715617 None] Created volume successfully.
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd" returned: 0 in 0.767s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:16 devstack quobyte-client[84528]: System call of process 103243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:16 devstack quobyte-client[84528]: System call of process 103243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:16 devstack quobyte-client[84528]: System call of process 103243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e-delete_volume" acquired by "delete_volume" :: waited 0.300s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:16 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=152, name=volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 1G" returned: 0 in 0.496s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7c49452c-4609-440e-8e6c-ff61c686cecd -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:16 devstack quobyte-client[84528]: System call of process 103246 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img rebase -u -b volume-7c49452c-4609-440e-8e6c-ff61c686cecd -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.368s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:33:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:16 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-quobyte-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.508s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" acquired by "delete_volume" :: waited 0.424s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:17 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0674a281-dd14-4e3b-8aa0-9c9cc4e340a1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 0 in 3.389s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.702s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.635s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.info" returned: 0 in 0.301s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" returned: 0 in 0.719s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.info" returned: 0 in 0.234s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:18 devstack sudo[103255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD
Sep 24 18:33:18 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:33:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" returned: 0 in 0.389s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e" released by "delete_volume" :: held 1.695s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9f1c5630-1727-4dc7-870f-9a02c1958d9a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Create snapshot completed successfully
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Created reservations ['ce595cea-e38a-4f30-ab71-6f92da8d8944', '74b7f75b-4f5c-4f58-a036-cbf7cf151a98', 'da96d4e0-b614-4607-b65d-09c8d6fafd12', 'a4cbf281-8d7a-4487-a08f-237d208ba182'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.160s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:19 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:19 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Deleted volume successfully.
Sep 24 18:33:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-689d5303-dc28-4787-9fff-c170f0edbd5a tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-1dd36325-d2a0-4ddc-a2f8-7319ef7ed68e-delete_volume" released by "delete_volume" :: held 4.613s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:20 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root
Sep 24 18:33:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 1 in 2.818s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:20 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:20 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Temporary image c47935a4-d017-4be4-84d8-7e6a60df0146 is fetched for user ec9f11c0cd154027a59a15ea854f9aad. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:33:21 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1383d5f0-1b6d-445c-bfc5-aed7e59ec06e]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:21 devstack sudo[103268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD
Sep 24 18:33:21 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-e2f685d0-5a7a-453c-8141-a104ea60c1f7-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-e2f685d0-5a7a-453c-8141-a104ea60c1f7-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-quobyte-e2f685d0-5a7a-453c-8141-a104ea60c1f7" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-e2f685d0-5a7a-453c-8141-a104ea60c1f7" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:22 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (9d5481dd-b36e-4f54-98c3-0267332a46ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8a0aa-aa46-4e64-97ce-35d03d06420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca69b0-c24f-4e71-afec-235e9b731326]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb8a0aa-aa46-4e64-97ce-35d03d06420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94720745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14a658e-b436-458a-a94c-40aa822f3124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:22Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced983e0-898b-4232-a1f8-e0eea6ac1747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced983e0-898b-4232-a1f8-e0eea6ac1747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25948b1-1d1e-454a-af8c-68cb8b81391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e25948b1-1d1e-454a-af8c-68cb8b81391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14a658e-b436-458a-a94c-40aa822f3124', 'volume_name': 'volume-d14a658e-b436-458a-a94c-40aa822f3124', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3d565-39f4-4af0-b508-733101308598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8a3d565-39f4-4af0-b508-733101308598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3861454-7ab1-4e89-9449-5fbd82f3c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:23 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume d14a658e-b436-458a-a94c-40aa822f3124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14a658e-b436-458a-a94c-40aa822f3124', 'volume_size': 1}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94720745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14a658e-b436-458a-a94c-40aa822f3124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:22Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume d14a658e-b436-458a-a94c-40aa822f3124 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:23 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:23 devstack quobyte-client[84528]: System call of process 103270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:23 devstack quobyte-client[84528]: System call of process 103270 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:23 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=154, name=volume-d14a658e-b436-458a-a94c-40aa822f3124, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:24 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root
Sep 24 18:33:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 0 in 3.449s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124 1073741824" returned: 0 in 1.318s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7" returned: 0 in 2.297s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:25 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD
Sep 24 18:33:25 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:33:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (7a3e8913-df39-475e-ab4d-1fcccac335d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aac7202-f118-4e78-9d24-401083a69128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (3dfd6fcb-4325-4042-ac71-6414b12855dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405ea396-c14d-4d50-a3e8-44ce0d79461d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (24f11e9d-f428-4755-8a49-8fd364423156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da527a40-102f-4378-b436-29eadfc5ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124" returned: 0 in 0.842s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e2f685d0-5a7a-453c-8141-a104ea60c1f7" returned: 0 in 0.765s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (2362ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aac7202-f118-4e78-9d24-401083a69128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741182658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a927804-0bfb-429e-a016-f0e14aef5d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:23Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b8e7ea-8843-4b3f-91b4-ed4c1ab6f071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b8e7ea-8843-4b3f-91b4-ed4c1ab6f071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de94b167-97c6-4ded-81fc-75ae3918ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de94b167-97c6-4ded-81fc-75ae3918ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a927804-0bfb-429e-a016-f0e14aef5d7e', 'volume_name': 'volume-8a927804-0bfb-429e-a016-f0e14aef5d7e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f9dacd-29ff-4c4b-9f73-95c8ca00ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f9dacd-29ff-4c4b-9f73-95c8ca00ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d692d7a9-3465-4181-a251-0f1c4f2d250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume 8a927804-0bfb-429e-a016-f0e14aef5d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a927804-0bfb-429e-a016-f0e14aef5d7e', 'volume_size': 1}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741182658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a927804-0bfb-429e-a016-f0e14aef5d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:23Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume 8a927804-0bfb-429e-a016-f0e14aef5d7e {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:26 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:26 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:26 devstack quobyte-client[84528]: System call of process 103285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:26 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=155, name=volume-8a927804-0bfb-429e-a016-f0e14aef5d7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (67099fbc-901b-4fa3-a35c-4b54605e8e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81855bf5-d660-4efb-a6a0-34c2424a8ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-e2f685d0-5a7a-453c-8141-a104ea60c1f7" released by "delete_volume" :: held 4.261s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81855bf5-d660-4efb-a6a0-34c2424a8ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526603782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accc45ee-8700-4fe9-86f6-0291c748856f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:25Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229ae0ee-f2a1-4202-8a3c-b2646c9d24d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229ae0ee-f2a1-4202-8a3c-b2646c9d24d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2edd83-d573-42b2-b8dd-af65487515de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2edd83-d573-42b2-b8dd-af65487515de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accc45ee-8700-4fe9-86f6-0291c748856f', 'volume_name': 'volume-accc45ee-8700-4fe9-86f6-0291c748856f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8bee98-1eb9-4d2c-b920-5fed2062ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8bee98-1eb9-4d2c-b920-5fed2062ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbae247-a967-4c56-8344-1715c9715ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume accc45ee-8700-4fe9-86f6-0291c748856f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accc45ee-8700-4fe9-86f6-0291c748856f', 'volume_size': 1}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405ea396-c14d-4d50-a3e8-44ce0d79461d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903068910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:24Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637788c4-6f08-4dbd-94e5-28e3ca7b38a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637788c4-6f08-4dbd-94e5-28e3ca7b38a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa80f0-7f6f-4718-91a0-61cc8afde3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa80f0-7f6f-4718-91a0-61cc8afde3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3', 'volume_name': 'volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbccbd3f-70bf-4d71-8e4a-3eac6972a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbccbd3f-70bf-4d71-8e4a-3eac6972a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf9a365-abb3-4a7b-aa36-f03d7c19e9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume 05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3', 'volume_size': 1}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da527a40-102f-4378-b436-29eadfc5ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374862591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e7e948-d2cd-466a-8fbd-6a86db2a93ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:23Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5e1ff8-444c-401a-8bc2-db84ee0d4d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5e1ff8-444c-401a-8bc2-db84ee0d4d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0132c5-8760-432a-b19b-e16377853b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0132c5-8760-432a-b19b-e16377853b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e7e948-d2cd-466a-8fbd-6a86db2a93ee', 'volume_name': 'volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8b9126-7fa1-466b-8724-4a44a20dadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8b9126-7fa1-466b-8724-4a44a20dadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce74b52-2d85-49a8-99bd-549078b90037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume b0e7e948-d2cd-466a-8fbd-6a86db2a93ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee', 'volume_size': 1}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3861454-7ab1-4e89-9449-5fbd82f3c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14a658e-b436-458a-a94c-40aa822f3124', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218ad9dd-88ba-4938-815f-9fbce5a1e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e 1073741824" returned: 0 in 0.967s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:27 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-d14a658e-b436-458a-a94c-40aa822f3124 (d14a658e-b436-458a-a94c-40aa822f3124): created successfully
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218ad9dd-88ba-4938-815f-9fbce5a1e836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (9d5481dd-b36e-4f54-98c3-0267332a46ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e" returned: 0 in 0.632s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (1657ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1526603782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accc45ee-8700-4fe9-86f6-0291c748856f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:25Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume accc45ee-8700-4fe9-86f6-0291c748856f {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:27 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:27 devstack quobyte-client[84528]: System call of process 103292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:28 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=156, name=volume-accc45ee-8700-4fe9-86f6-0291c748856f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:28 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-b94cef9d-f8a7-4d0c-a46a-b103fec61e2e tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:28 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d692d7a9-3465-4181-a251-0f1c4f2d250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a927804-0bfb-429e-a016-f0e14aef5d7e', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f797900-a8ae-4ba3-a312-c1f81d841224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 1 in 3.684s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f 1073741824" returned: 0 in 0.778s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Created reservations ['71aed7d7-7658-4c08-a4ac-d669cc9b9ab2', '169e6f2b-f6ce-4732-ac30-1fecf43118b9', '0ab6afc9-f516-4d6a-86d2-4b71afbcc85e', '0fafe78d-3f40-4433-9b1f-2e1355820270'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:28 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-8a927804-0bfb-429e-a016-f0e14aef5d7e (8a927804-0bfb-429e-a016-f0e14aef5d7e): created successfully
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f797900-a8ae-4ba3-a312-c1f81d841224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (7a3e8913-df39-475e-ab4d-1fcccac335d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f" returned: 0 in 0.377s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (1191ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903068910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:24Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume 05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:29 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:29 devstack quobyte-client[84528]: System call of process 103296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:29 devstack quobyte-client[84528]: System call of process 103296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:29 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=157, name=volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-649d5df6-ca11-4700-8ff0-0156031c504a tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbae247-a967-4c56-8344-1715c9715ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accc45ee-8700-4fe9-86f6-0291c748856f', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9790a3-5c87-46b6-b2c9-375cb0e04ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:29 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-accc45ee-8700-4fe9-86f6-0291c748856f (accc45ee-8700-4fe9-86f6-0291c748856f): created successfully
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9790a3-5c87-46b6-b2c9-375cb0e04ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (67099fbc-901b-4fa3-a35c-4b54605e8e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:29 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-92be32de-7d88-415b-bb71-01585739de75 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 1073741824" returned: 0 in 0.752s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.061s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" returned: 0 in 0.462s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (1303ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.600s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374862591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e7e948-d2cd-466a-8fbd-6a86db2a93ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3eed654a4d4499c8501cd6fff174780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:23Z,use_quota=True,user_id='05a05392eb3e415097ed2344aa8d6f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Creating volume b0e7e948-d2cd-466a-8fbd-6a86db2a93ee {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:30 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:30 devstack quobyte-client[84528]: System call of process 103301 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:30 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=158, name=volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:30 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-117c7583-254a-4f21-a08c-8934830f6a08-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf9a365-abb3-4a7b-aa36-f03d7c19e9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85f89ff-2b81-4736-9a67-6f684fb77beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-117c7583-254a-4f21-a08c-8934830f6a08-delete_volume" acquired by "delete_volume" :: waited 0.550s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 1.380s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee 1073741824" returned: 0 in 0.905s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Deleted volume successfully.
Sep 24 18:33:31 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 (05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3): created successfully
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85f89ff-2b81-4736-9a67-6f684fb77beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (3dfd6fcb-4325-4042-ac71-6414b12855dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:32 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-7e06d93d-b8c4-4ab0-a80e-4a557c1515a5 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" returned: 0 in 0.591s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] <== create_volume: return (1543ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-84a483ca-0965-414a-a9b6-7e6df7d2c82f tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-e2f685d0-5a7a-453c-8141-a104ea60c1f7-delete_volume" released by "delete_volume" :: held 10.020s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.672s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4d0cb7-20bd-4f03-b906-c6a97c0a9314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e87b2c86fe48b29907c78f943d32ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:10Z,use_quota=True,user_id='ec9f11c0cd154027a59a15ea854f9aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Creating volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:32 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:32 devstack quobyte-client[84528]: System call of process 103305 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:32 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=159, name=volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce74b52-2d85-49a8-99bd-549078b90037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:32 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06079731-4568-4eb1-86e9-bc7424f13b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:33 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-quobyte-117c7583-254a-4f21-a08c-8934830f6a08" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:33 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee (b0e7e948-d2cd-466a-8fbd-6a86db2a93ee): created successfully
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06079731-4568-4eb1-86e9-bc7424f13b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Flow 'volume_create_manager' (24f11e9d-f428-4755-8a49-8fd364423156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-117c7583-254a-4f21-a08c-8934830f6a08" acquired by "delete_volume" :: waited 0.141s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e398e9ff-968a-4a6c-a2fe-ab63b53457aa tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created volume successfully.
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 1073741824" returned: 0 in 1.071s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72b9c9e-9258-430a-b478-cfaef18be032]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 0 in 0.377s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] <== create_volume: return (1530ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:33:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:34 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Attempting download of c47935a4-d017-4be4-84d8-7e6a60df0146 ((None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}])) to volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 24 18:33:34 devstack quobyte-client[84528]: System call of process 103309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:34 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbcbb0-afbe-4c7f-a0a1-512d94677b8e]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c47935a4-d017-4be4-84d8-7e6a60df0146_qsyb6s_r {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-accc45ee-8700-4fe9-86f6-0291c748856f-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08" returned: 0 in 1.410s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-accc45ee-8700-4fe9-86f6-0291c748856f-delete_volume" acquired by "delete_volume" :: waited 0.354s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-117c7583-254a-4f21-a08c-8934830f6a08" returned: 0 in 0.425s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c47935a4-d017-4be4-84d8-7e6a60df0146_qsyb6s_r" returned: 0 in 0.818s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c47935a4-d017-4be4-84d8-7e6a60df0146_qsyb6s_r {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-117c7583-254a-4f21-a08c-8934830f6a08" released by "delete_volume" :: held 2.785s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:36 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-accc45ee-8700-4fe9-86f6-0291c748856f" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-accc45ee-8700-4fe9-86f6-0291c748856f" acquired by "delete_volume" :: waited 0.090s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[959eb912-53fa-4e61-85b1-e227c2190412]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c47935a4-d017-4be4-84d8-7e6a60df0146_qsyb6s_r" returned: 1 in 0.983s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c47935a4-d017-4be4-84d8-7e6a60df0146_qsyb6s_r' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41e2f2-9e41-4e14-abb2-4c1051b765c2]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Created reservations ['fe23206b-fa65-4f4a-9cbb-59249e4f8d0d', '40105398-d062-4aae-99c3-859a1929cf6f', '9d489cb9-fc85-49fe-852b-8fb50166fc9b', 'ab57012d-be97-4963-ad61-969bf4f75964'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f" returned: 0 in 0.773s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-accc45ee-8700-4fe9-86f6-0291c748856f" returned: 0 in 0.279s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 0 in 0.857s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-edccf0be-b40c-4dbc-ac52-bb32c8a07c59-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:37 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-accc45ee-8700-4fe9-86f6-0291c748856f" released by "delete_volume" :: held 1.664s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-edccf0be-b40c-4dbc-ac52-bb32c8a07c59-delete_volume" acquired by "delete_volume" :: waited 0.260s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD" returned: 1 in 0.975s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:38 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-quobyte-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['a446f8a5-e32d-4187-af07-932f6e49ed57', '41d0b8f3-8cb3-46ad-879d-43f1de0c77e6', '90a23edb-90c1-4d3d-b671-8d6325649207', '48ad77f1-8386-4411-8214-78d7089dad1a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] c47935a4-d017-4be4-84d8-7e6a60df0146 was raw, converting to raw {{(pid=84502) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:38 devstack quobyte-client[84528]: System call of process 103329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:38 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=159, name=volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.840s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:38 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 0 in 0.450s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" acquired by "delete_volume" :: waited 0.530s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c47935a4-d017-4be4-84d8-7e6a60df0146_u_a52zoldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:33:39 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Converted 0.00 MB image at 0.00 MB/s
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:39 devstack quobyte-client[84528]: System call of process 103332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:39 devstack quobyte-client[84528]: System call of process 103332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1cbbd7-277e-4e40-ba9a-243145ea9f5a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:39 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:39 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Deleted volume successfully.
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 1G" returned: 0 in 0.972s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3-delete_volume" acquired by "delete_volume" :: waited 0.516s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0aeaf6cb-b3a0-4039-8a29-5977e6c0b3a3 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-117c7583-254a-4f21-a08c-8934830f6a08-delete_volume" released by "delete_volume" :: held 8.603s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[66137501-914c-4b1d-ac3a-678c40c9c561]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:40 devstack quobyte-client[84528]: System call of process 103335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84528]: System call of process 103335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.044s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:40 devstack quobyte-client[84528]: System call of process 103337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84528]: System call of process 103337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" returned: 0 in 1.312s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:41 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 0 in 0.982s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.712s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" returned: 0 in 0.506s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" acquired by "delete_volume" :: waited 0.478s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e4d05989-6c98-4489-be5f-6992426ed155 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-accc45ee-8700-4fe9-86f6-0291c748856f-delete_volume" released by "delete_volume" :: held 6.324s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-edccf0be-b40c-4dbc-ac52-bb32c8a07c59" released by "delete_volume" :: held 2.627s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[31373259-ea17-408b-8f33-27a63d8568bc]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 1 in 0.785s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Downloaded image c47935a4-d017-4be4-84d8-7e6a60df0146 ((None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}])) to volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 successfully. {{(pid=84502) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Temporary image c47935a4-d017-4be4-84d8-7e6a60df0146 for user ec9f11c0cd154027a59a15ea854f9aad is deleted. {{(pid=84502) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:33:41 devstack cinder-volume[84502]: DEBUG cinder.volume.volume_utils [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Marking volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 as bootable. {{(pid=84502) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Copying metadata from image c47935a4-d017-4be4-84d8-7e6a60df0146 to 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314. {{(pid=84502) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Creating volume glance metadata for volume 9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 backed by image c47935a4-d017-4be4-84d8-7e6a60df0146 with: {'image_id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2bc0bea5ab1a85ccce0c1b0af949f6ff', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84502) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:33:42 devstack quobyte-client[84528]: System call of process 103343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:42 devstack quobyte-client[84528]: System call of process 103343 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" returned: 0 in 0.596s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Created reservations ['5f87d66e-29b7-4de5-95a0-f797b30f6816', '153fe8d7-7e51-454c-a2aa-9877db7e6101', 'bad9d868-6676-4079-820d-ed3f45821011', '957c4945-f236-40c7-a2ff-9139d01a9167'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a767ac72-e1a5-4403-9b95-976f76d71a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314', 'volume_size': 1, 'image_id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c47935a4-d017-4be4-84d8-7e6a60df0146', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bc0bea5ab1a85ccce0c1b0af949f6ff', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35e87b2c86fe48b29907c78f943d32ed', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '97d1e5339823f2b7d073a03f001e19271f8f839d66d3b1de1af25b0863142fa8569e214cd0a1f633233be5b4b907ae1c9fad3b52a6503961ba1b70264657d980', 'id': 'c47935a4-d017-4be4-84d8-7e6a60df0146', 'created_at': datetime.datetime(2025, 9, 24, 16, 33, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 33, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c47935a4-d017-4be4-84d8-7e6a60df0146/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f0b866c9990>}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3866b523-8092-4c6c-b11b-a92c116f090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" returned: 0 in 0.395s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:42 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Volume volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 (9b4d0cb7-20bd-4f03-b906-c6a97c0a9314): created successfully
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3866b523-8092-4c6c-b11b-a92c116f090b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Flow 'volume_create_manager' (e2c27ab4-6477-4916-9514-4babf24f8232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3" released by "delete_volume" :: held 1.249s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:42 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-10812d18-a03d-42e8-b2e8-5c1cd3843f69 tempest-VolumeImageDependencyTests-216972473 None] Created volume successfully.
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.492s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:43 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Deleted volume successfully.
Sep 24 18:33:43 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "cinder-quobyte-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-aa5600d1-7b37-459c-acd7-bdddc7f16c73 tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-edccf0be-b40c-4dbc-ac52-bb32c8a07c59-delete_volume" released by "delete_volume" :: held 5.646s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" acquired by "delete_volume" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['2fb56b04-6540-4d5e-9d5a-dce520a41c3e', 'f0e76e1f-4b93-4273-8292-95c694db6d74', 'b61a19b3-6f20-4f44-9325-77b9a6e596c1', '24c900cb-a613-45f8-b006-3896fb83dbc2'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a975c72-23ee-432c-b931-f5d6fe286bc4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Acquiring lock "cinder-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "cinder-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:44 devstack quobyte-client[84528]: System call of process 103350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:44 devstack quobyte-client[84528]: System call of process 103350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Acquiring lock "cinder-quobyte-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "cinder-quobyte-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" acquired by "delete_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37950d-54d3-43b6-ae59-e7cdf8074dcd]: (4, 'raw') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" returned: 0 in 1.006s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.350s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:44 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" returned: 0 in 0.404s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:45 devstack quobyte-client[84528]: System call of process 103354 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-quobyte-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f" released by "delete_volume" :: held 1.647s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-286b7c9c-66e5-4a80-841d-85971a429434 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-05c2483f-1b0b-4ca9-a220-c3a38a8fe0c3-delete_volume" released by "delete_volume" :: held 5.271s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 0 in 0.765s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Created reservations ['4db29200-ee38-463c-acb5-938d0e43dcda', 'c845751b-a3b2-4c9d-a717-497f5f014c06', 'c98ceb30-9be5-4ab6-9aa6-91e6941bd92f', '6a819642-a975-4e17-8569-8779beb7424f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:45 devstack quobyte-client[84528]: System call of process 103358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:45 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 1 in 0.641s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314' failed. Not Retrying. {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" acquired by "delete_volume" :: waited 0.213s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f5929b-f4b3-4c54-a171-724ede0b453f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" returned: 0 in 0.653s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "cinder-quobyte-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314" released by "delete_volume" :: held 2.390s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:46 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:47 devstack quobyte-client[84528]: System call of process 103362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:47 devstack quobyte-client[84528]: System call of process 103362 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" returned: 0 in 0.946s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.577s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Created reservations ['fe0cc0a1-4935-46e7-b36c-ff81e08ff976', 'eab9bb0c-82ed-43d1-af25-997ca1f4adb5', '281d0934-8420-4101-93be-7c9e338c3ac2', 'a8f16258-48a1-4553-9a2b-956e1e721467'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:47 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Deleted volume successfully.
Sep 24 18:33:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" returned: 0 in 0.551s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee" released by "delete_volume" :: held 1.831s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9b406724-39af-4053-b466-aa4efe468aeb tempest-CreateVolumesFromImageTest-1895715617 None] Lock "cinder-a9df4f1b-57ce-4dd1-bfe9-edf6748e1f1f-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['74651a96-ed91-47f5-b149-9693d042496e', '2fed0232-2cb2-446e-ad25-165538933786', 'ea4e6a25-1f0a-4542-bc44-b3e5ca74fdac', '14b13f68-fb6f-4954-a4e9-ba7d10b5a204'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.452s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:48 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:48 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Deleted volume successfully.
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-60344af3-ecb4-4a7c-affc-c822b96bb588 tempest-VolumeImageDependencyTests-216972473 None] Lock "cinder-9b4d0cb7-20bd-4f03-b906-c6a97c0a9314-delete_volume" released by "delete_volume" :: held 4.804s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.148s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:49 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-32932313-3689-4fc7-a505-0771044cbf77 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-b0e7e948-d2cd-466a-8fbd-6a86db2a93ee-delete_volume" released by "delete_volume" :: held 4.215s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-8a927804-0bfb-429e-a016-f0e14aef5d7e-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-8a927804-0bfb-429e-a016-f0e14aef5d7e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:50 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-8a927804-0bfb-429e-a016-f0e14aef5d7e" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-8a927804-0bfb-429e-a016-f0e14aef5d7e" acquired by "delete_volume" :: waited 0.024s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[719feb95-35d7-40d5-8bed-059b3a92c01b]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:50 devstack quobyte-client[84528]: System call of process 103370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:50 devstack quobyte-client[84528]: System call of process 103370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:50 devstack quobyte-client[84528]: System call of process 103370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:50 devstack quobyte-client[84528]: System call of process 103370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e" returned: 0 in 0.621s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-8a927804-0bfb-429e-a016-f0e14aef5d7e" returned: 0 in 0.138s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-8a927804-0bfb-429e-a016-f0e14aef5d7e" released by "delete_volume" :: held 1.086s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['285081d7-ac7f-4732-9ff5-8e7ad2fbee1f', '082c3675-cd08-49d5-b87f-23497cf2590e', 'c554bd45-88d8-4e23-b64c-49a714f701c7', '0a4def91-dcdf-4629-9025-e8fc45a705a2'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-985d14df-3527-4104-bee7-db0c936f4401 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-8a927804-0bfb-429e-a016-f0e14aef5d7e-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-d14a658e-b436-458a-a94c-40aa822f3124-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-d14a658e-b436-458a-a94c-40aa822f3124-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:52 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-d14a658e-b436-458a-a94c-40aa822f3124" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-d14a658e-b436-458a-a94c-40aa822f3124" acquired by "delete_volume" :: waited 0.016s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[78341cee-a4af-44ca-89ee-286672911c8a]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:53 devstack quobyte-client[84528]: System call of process 103375 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124" returned: 0 in 0.548s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d14a658e-b436-458a-a94c-40aa822f3124" returned: 0 in 0.125s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-d14a658e-b436-458a-a94c-40aa822f3124" released by "delete_volume" :: held 0.895s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:53 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['68ffcfc1-f8bb-4923-8937-d0ebee1eb547', '9c3d217f-bb72-4da7-b306-9b2a1dc4d8bc', '61567f24-f22d-414c-96e0-37f9a84747c3', 'f853a5ef-010f-4719-8d48-698583b73f8b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.115s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:54 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8f6ac10a-e01c-46e5-a17b-4ee33f7847d8 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-d14a658e-b436-458a-a94c-40aa822f3124-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-a3e22f7e-d6ac-403c-bcf8-518436818ac9-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-a3e22f7e-d6ac-403c-bcf8-518436818ac9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:54 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-a3e22f7e-d6ac-403c-bcf8-518436818ac9" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-a3e22f7e-d6ac-403c-bcf8-518436818ac9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleting offline snapshot a3e22f7e-d6ac-403c-bcf8-518436818ac9 of volume 7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] snapshot_file for this snap is: volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ce1e6-33d6-42a8-af65-537fc093efb1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:55 devstack quobyte-client[84528]: System call of process 103381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:55 devstack quobyte-client[84528]: System call of process 103381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:55 devstack quobyte-client[84528]: System call of process 103381 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.600s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c49452c-4609-440e-8e6c-ff61c686cecd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ed6cf9-a04e-4749-bcd6-723e1bfb400f]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:56 devstack quobyte-client[84528]: System call of process 103414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:56 devstack quobyte-client[84528]: System call of process 103414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd" returned: 0 in 0.689s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:56 devstack quobyte-client[84528]: System call of process 103419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.329s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:57 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd.a3e22f7e-d6ac-403c-bcf8-518436818ac9" returned: 0 in 0.147s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-a3e22f7e-d6ac-403c-bcf8-518436818ac9" released by "_delete_snapshot" :: held 2.264s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" released by "delete_snapshot" :: held 2.317s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:57 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['b461d1fa-244b-4f82-aa00-99372712f454', '73063746-37d0-4ebd-bb9b-7fcc1b1a846e', '3891555d-b5f7-4b1e-acbf-237cf0fc2384', '501e0d41-0e43-45c8-b6c4-d57c59879f78'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Delete snapshot completed successfully.
Sep 24 18:33:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f21d0d1c-baa5-45d5-b211-2ca827b57b39 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-a3e22f7e-d6ac-403c-bcf8-518436818ac9-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-7c49452c-4609-440e-8e6c-ff61c686cecd-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-7c49452c-4609-440e-8e6c-ff61c686cecd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" acquired by "delete_volume" :: waited 0.017s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b05fa0-fd97-424d-a90e-4e690b9fa791]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd" returned: 0 in 0.686s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-7c49452c-4609-440e-8e6c-ff61c686cecd" returned: 0 in 0.133s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-quobyte-7c49452c-4609-440e-8e6c-ff61c686cecd" released by "delete_volume" :: held 1.104s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Created reservations ['efe86672-2025-45c2-8b46-0a49252348e9', 'a68a37ac-3bd1-4a09-b56b-5732d62983ba', '7384b4f2-17ae-45b5-bd70-3d4303814466', '48472c1e-0459-4dfd-81b9-aea3b3cefdf4'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.174s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:00 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Deleted volume successfully.
Sep 24 18:34:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-0cf55cc2-8e57-4cf7-967e-c31a2dc44906 tempest-CreateVolumesFromSnapshotTest-1800328538 None] Lock "cinder-7c49452c-4609-440e-8e6c-ff61c686cecd-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:04 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=135,cinder:SELECT=77,cinder:DELETE=16,cinder:INSERT=21 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:34:04 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=91,cinder:UPDATE=122,cinder:DELETE=9,cinder:INSERT=40 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:34:05 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (49114f67-9915-4bcb-bec7-f0f1fee2c36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f60d01-6d11-4df0-a942-4d4ce2d70bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9f60d01-6d11-4df0-a942-4d4ce2d70bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296045698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1de39ee-d21d-44f1-906d-8a3224de3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:05Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed16a89-f58b-4e2a-82a9-081789904fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed16a89-f58b-4e2a-82a9-081789904fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97621db1-2263-411e-8d1f-b6d80e96f866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97621db1-2263-411e-8d1f-b6d80e96f866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1de39ee-d21d-44f1-906d-8a3224de3d6c', 'volume_name': 'volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c34e3cc-620d-4b2c-b2c7-d62c14038f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c34e3cc-620d-4b2c-b2c7-d62c14038f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a86518-6f94-449c-b0c3-d5b449c6d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume a1de39ee-d21d-44f1-906d-8a3224de3d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c', 'volume_size': 1}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1296045698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1de39ee-d21d-44f1-906d-8a3224de3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:05Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume a1de39ee-d21d-44f1-906d-8a3224de3d6c {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:05 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:05 devstack quobyte-client[84528]: System call of process 103435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:05 devstack quobyte-client[84528]: System call of process 103435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:05 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=160, name=volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c 1073741824" returned: 0 in 0.561s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:05 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c" returned: 0 in 0.124s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (775ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a86518-6f94-449c-b0c3-d5b449c6d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4f0452-b8e4-489e-9a6b-d5ed52517275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:06 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c (a1de39ee-d21d-44f1-906d-8a3224de3d6c): created successfully
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4f0452-b8e4-489e-9a6b-d5ed52517275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:06 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (49114f67-9915-4bcb-bec7-f0f1fee2c36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:06 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-bf65e101-d0c0-4bca-a3aa-61082d530860 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:07 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (7fb2eb50-dc45-41e1-acf0-c0551422e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa96ed-26bd-4aef-84b0-87aa50d15061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafa96ed-26bd-4aef-84b0-87aa50d15061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583076743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc6eaa0-5ca1-42d4-a802-59e88033dcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:07Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a086a-5730-44e1-b679-015b4b4af88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a086a-5730-44e1-b679-015b4b4af88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a0a9b-1c04-4a5c-b8a6-6f7be9e9260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67a0a9b-1c04-4a5c-b8a6-6f7be9e9260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc6eaa0-5ca1-42d4-a802-59e88033dcb9', 'volume_name': 'volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce816d3-3c13-4eef-98de-e31a70d977f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce816d3-3c13-4eef-98de-e31a70d977f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41689e57-d069-4cdc-b853-efb3af28cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:07 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume 1bc6eaa0-5ca1-42d4-a802-59e88033dcb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9', 'volume_size': 1}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1583076743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc6eaa0-5ca1-42d4-a802-59e88033dcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:07Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume 1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:07 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:07 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:08 devstack quobyte-client[84528]: System call of process 103439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:08 devstack quobyte-client[84528]: System call of process 103439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:08 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=161, name=volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 1073741824" returned: 0 in 0.724s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:08 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:08 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:08 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:08 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (fb4142a9-470b-4e8a-b2b4-ccea22d4424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0d265-0c0a-4ca9-a55a-b2e40cd58cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f0d265-0c0a-4ca9-a55a-b2e40cd58cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1373643302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8185c04-2ee0-40cf-a9f2-5b70d46cc370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:08Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b583d8-6b07-46c5-ae2f-cfef23a57aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92b583d8-6b07-46c5-ae2f-cfef23a57aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be271d09-78b4-42fc-914f-24d0e056e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be271d09-78b4-42fc-914f-24d0e056e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8185c04-2ee0-40cf-a9f2-5b70d46cc370', 'volume_name': 'volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86d368f-3fac-42c7-9b91-2c6203232bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86d368f-3fac-42c7-9b91-2c6203232bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b56a3-a78b-45af-bd43-fa8a78b5c913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume d8185c04-2ee0-40cf-a9f2-5b70d46cc370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370', 'volume_size': 1}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" returned: 0 in 0.808s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (1578ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1373643302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8185c04-2ee0-40cf-a9f2-5b70d46cc370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:08Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume d8185c04-2ee0-40cf-a9f2-5b70d46cc370 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:09 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:09 devstack quobyte-client[84528]: System call of process 103443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:09 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=162, name=volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41689e57-d069-4cdc-b853-efb3af28cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378a2ed2-02d5-4ecb-894e-eaa5b1bd505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:09 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (8af95bb9-3315-4724-966e-18ceebefeedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd7f842-8f3d-4c39-b38c-86ca44148ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 (1bc6eaa0-5ca1-42d4-a802-59e88033dcb9): created successfully
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378a2ed2-02d5-4ecb-894e-eaa5b1bd505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (7fb2eb50-dc45-41e1-acf0-c0551422e30c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd7f842-8f3d-4c39-b38c-86ca44148ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875439314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad169f32-5515-486e-8914-02b4c7fe5286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:09Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecb3d0f-11c7-484e-84eb-a4927e358bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecb3d0f-11c7-484e-84eb-a4927e358bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240c38f6-af31-4f6b-9812-5254df839e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240c38f6-af31-4f6b-9812-5254df839e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad169f32-5515-486e-8914-02b4c7fe5286', 'volume_name': 'volume-ad169f32-5515-486e-8914-02b4c7fe5286', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6706e7-deec-4ec0-a08b-9054318bdd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6706e7-deec-4ec0-a08b-9054318bdd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b4a8bc-c0c6-4015-83b7-235e4e43d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume ad169f32-5515-486e-8914-02b4c7fe5286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad169f32-5515-486e-8914-02b4c7fe5286', 'volume_size': 1}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:10 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (dc6dfb5e-2332-4049-8515-0bfe5d668401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1ea55d-86d6-467f-9569-b50d70a341f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 1073741824" returned: 0 in 0.943s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:10 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f53197d4-d7be-4e63-84c4-3b4e4d8afbfa tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1ea55d-86d6-467f-9569-b50d70a341f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73296693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c5874f-0de8-4686-8503-fc32733eb5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:10Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48da1f-1488-421b-9743-3840f90c5f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48da1f-1488-421b-9743-3840f90c5f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67934d4-390e-487e-b840-ce10a9efdf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67934d4-390e-487e-b840-ce10a9efdf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c5874f-0de8-4686-8503-fc32733eb5be', 'volume_name': 'volume-f7c5874f-0de8-4686-8503-fc32733eb5be', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b33ad-2ece-41a1-ad80-17d0a887a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760b33ad-2ece-41a1-ad80-17d0a887a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a2e287-ae13-4fae-9e65-96bd7d163047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume f7c5874f-0de8-4686-8503-fc32733eb5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c5874f-0de8-4686-8503-fc32733eb5be', 'volume_size': 1}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" returned: 0 in 0.656s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (1627ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875439314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad169f32-5515-486e-8914-02b4c7fe5286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:09Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume ad169f32-5515-486e-8914-02b4c7fe5286 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:11 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:11 devstack quobyte-client[84528]: System call of process 103448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:11 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:11 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=163, name=volume-ad169f32-5515-486e-8914-02b4c7fe5286, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (d407eeda-0d2d-45d4-91d7-dd83e0f7b883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e703a2-577e-49f4-8517-68a418a8c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e703a2-577e-49f4-8517-68a418a8c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337442650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3739670-9692-4e2d-be21-a87226117f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:11Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947290ea-abcc-4b04-9680-fe3aad341519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947290ea-abcc-4b04-9680-fe3aad341519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad011c4-6d85-45c9-9b14-d5d65215b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad011c4-6d85-45c9-9b14-d5d65215b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3739670-9692-4e2d-be21-a87226117f66', 'volume_name': 'volume-e3739670-9692-4e2d-be21-a87226117f66', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a68df0-3deb-4b2e-8de8-694e60159b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a68df0-3deb-4b2e-8de8-694e60159b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d83a9-a293-4143-9818-a7473fcac458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume e3739670-9692-4e2d-be21-a87226117f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3739670-9692-4e2d-be21-a87226117f66', 'volume_size': 1}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87b56a3-a78b-45af-bd43-fa8a78b5c913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74752f95-9a3c-4680-a925-e8f26bb0c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286 1073741824" returned: 0 in 0.663s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286" returned: 0 in 0.193s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (906ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:11 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73296693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c5874f-0de8-4686-8503-fc32733eb5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:10Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume f7c5874f-0de8-4686-8503-fc32733eb5be {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:12 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:12 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 (d8185c04-2ee0-40cf-a9f2-5b70d46cc370): created successfully
Sep 24 18:34:12 devstack quobyte-client[84528]: System call of process 103452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:12 devstack quobyte-client[84528]: System call of process 103452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:12 devstack quobyte-client[84528]: System call of process 103452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:12 devstack quobyte-client[84528]: System call of process 103452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:12 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=164, name=volume-f7c5874f-0de8-4686-8503-fc32733eb5be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74752f95-9a3c-4680-a925-e8f26bb0c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (fb4142a9-470b-4e8a-b2b4-ccea22d4424f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:12 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3c9c6119-45c3-4652-b0b3-937968cf6fec tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b4a8bc-c0c6-4015-83b7-235e4e43d98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad169f32-5515-486e-8914-02b4c7fe5286', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64554b52-c25a-48a6-9f16-08648c0e4b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be 1073741824" returned: 0 in 0.593s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:12 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-ad169f32-5515-486e-8914-02b4c7fe5286 (ad169f32-5515-486e-8914-02b4c7fe5286): created successfully
Sep 24 18:34:12 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64554b52-c25a-48a6-9f16-08648c0e4b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (8af95bb9-3315-4724-966e-18ceebefeedb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be" returned: 0 in 0.479s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:13 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-fffefd62-d2ff-4621-b234-7ecc39845187 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (1145ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-337442650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3739670-9692-4e2d-be21-a87226117f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24dfc70a2a749e6b5ce748e88026d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:11Z,use_quota=True,user_id='8696cc5bdee44fb8b2baaa973d04fb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Creating volume e3739670-9692-4e2d-be21-a87226117f66 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:13 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:13 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=165, name=volume-e3739670-9692-4e2d-be21-a87226117f66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a2e287-ae13-4fae-9e65-96bd7d163047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c5874f-0de8-4686-8503-fc32733eb5be', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3b08b0-2951-457b-a31d-57c904c51d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66 1073741824" returned: 0 in 0.541s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:13 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:13 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-f7c5874f-0de8-4686-8503-fc32733eb5be (f7c5874f-0de8-4686-8503-fc32733eb5be): created successfully
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3b08b0-2951-457b-a31d-57c904c51d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (dc6dfb5e-2332-4049-8515-0bfe5d668401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66" returned: 0 in 0.354s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] <== create_volume: return (926ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f694f172-84a9-4d93-8d3a-21fe26725936 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18d83a9-a293-4143-9818-a7473fcac458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3739670-9692-4e2d-be21-a87226117f66', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bed38f-0283-4af2-905e-c44592aa1098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:14 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume volume-e3739670-9692-4e2d-be21-a87226117f66 (e3739670-9692-4e2d-be21-a87226117f66): created successfully
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bed38f-0283-4af2-905e-c44592aa1098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Flow 'volume_create_manager' (d407eeda-0d2d-45d4-91d7-dd83e0f7b883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:14 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-3d3c870a-fef2-44f5-9f22-5667759f42a1 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created volume successfully.
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-e3739670-9692-4e2d-be21-a87226117f66-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:14 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-e3739670-9692-4e2d-be21-a87226117f66-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:15 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-e3739670-9692-4e2d-be21-a87226117f66" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-e3739670-9692-4e2d-be21-a87226117f66" acquired by "delete_volume" :: waited 0.025s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31ad9b9-f82a-4093-a34f-6b1b71ec5365]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66" returned: 0 in 0.510s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:15 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-e3739670-9692-4e2d-be21-a87226117f66" returned: 0 in 0.123s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-e3739670-9692-4e2d-be21-a87226117f66" released by "delete_volume" :: held 0.858s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['451e104a-bc41-43a1-b5f2-0f025f906f3d', '3d2f6597-77d0-44b3-922a-fce9cb11e3ac', '514e64c9-d8c9-4541-8d95-608671e26b9b', '00b4a841-8501-45e7-bc61-1f63b1b38d7b'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.096s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:16 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:16 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-f7c5874f-0de8-4686-8503-fc32733eb5be-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-49344914-bbb8-42aa-9c24-dc22b5c33311 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-e3739670-9692-4e2d-be21-a87226117f66-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-f7c5874f-0de8-4686-8503-fc32733eb5be-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:17 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-f7c5874f-0de8-4686-8503-fc32733eb5be" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.339s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-f7c5874f-0de8-4686-8503-fc32733eb5be" acquired by "delete_volume" :: waited 0.168s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d6fab8-949c-4010-8b91-c1f2cd2a0dc4]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be" returned: 0 in 0.652s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:18 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-f7c5874f-0de8-4686-8503-fc32733eb5be" returned: 0 in 0.142s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-f7c5874f-0de8-4686-8503-fc32733eb5be" released by "delete_volume" :: held 0.987s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['feded914-4389-4811-9107-72d6e429c65d', 'a9ef8c96-cb80-429a-a6b3-faedc3945472', '7049be25-e3dc-4b56-86e5-2f809c0d1c53', '1a1bf3af-5c9e-4364-9ffb-4bedc622d8d1'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.129s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:19 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:20 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-413a8324-ae21-4bb3-8357-46178181255c tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-f7c5874f-0de8-4686-8503-fc32733eb5be-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-ad169f32-5515-486e-8914-02b4c7fe5286-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:20 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-ad169f32-5515-486e-8914-02b4c7fe5286-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:21 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-ad169f32-5515-486e-8914-02b4c7fe5286" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-ad169f32-5515-486e-8914-02b4c7fe5286" acquired by "delete_volume" :: waited 0.012s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ec657-7778-4d0f-9a65-e80c91bbfe50]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286" returned: 0 in 0.486s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:21 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-ad169f32-5515-486e-8914-02b4c7fe5286" returned: 0 in 0.128s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-ad169f32-5515-486e-8914-02b4c7fe5286" released by "delete_volume" :: held 0.838s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['28da6c0f-d46a-4385-8141-411444783428', '12913c10-cc05-4ed7-8051-7c1329a2efa1', '2e63ead0-1cad-4914-b334-4297790baefe', 'cbb68151-b62e-4875-956f-ccfac7ce8681'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.160s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:22 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:22 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-a02ff5d5-8d5a-4216-8229-1761c69a4ea3 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-ad169f32-5515-486e-8914-02b4c7fe5286-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-d8185c04-2ee0-40cf-a9f2-5b70d46cc370-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-d8185c04-2ee0-40cf-a9f2-5b70d46cc370-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:23 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" acquired by "delete_volume" :: waited 0.014s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c9dca-f228-4c19-8503-300f9e75ecc9]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:23 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:24 devstack quobyte-client[84528]: System call of process 103479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" returned: 0 in 0.569s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:24 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" returned: 0 in 0.174s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:24 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-d8185c04-2ee0-40cf-a9f2-5b70d46cc370" released by "delete_volume" :: held 0.958s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:25 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Flow 'volume_create_manager' (96bb8bf3-ef6b-489d-83f5-e05dade51f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef588ba-9720-41b5-824d-db949de417b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['4c6c29e0-f315-4f68-88e3-71cc5291e95f', 'a3f93c75-2c99-4dd2-9150-f9e264e6282d', '5f50c34e-bc33-4fa9-bf42-6ee69f471591', 'f51f8e5c-0498-430b-89c4-636893192f7a'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef588ba-9720-41b5-824d-db949de417b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1300572597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a44ac29c50461d9403a79e6427c728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:25Z,use_quota=True,user_id='5e1816093bb0463a8a19dcecd31b842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f59f02-3a49-41d9-addf-215b67b00ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f59f02-3a49-41d9-addf-215b67b00ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f117a6-0aff-46d8-af14-c4bd39ad28b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f117a6-0aff-46d8-af14-c4bd39ad28b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5', 'volume_name': 'volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f075e1-6a49-4ce0-8f6b-43bb9531158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9f075e1-6a49-4ce0-8f6b-43bb9531158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b7f8b-6b66-4627-9955-287300d5191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Volume 9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5', 'volume_size': 1}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1300572597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a44ac29c50461d9403a79e6427c728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:25Z,use_quota=True,user_id='5e1816093bb0463a8a19dcecd31b842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Creating volume 9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:25 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:25 devstack quobyte-client[84528]: System call of process 103484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:25 devstack quobyte-client[84528]: System call of process 103484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:25 devstack quobyte-client[84528]: System call of process 103484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:25 devstack quobyte-client[84528]: System call of process 103484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:25 devstack quobyte-client[84528]: System call of process 103484 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:25 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=166, name=volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 1073741824" returned: 0 in 0.504s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:25 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.194s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] <== create_volume: return (754ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b7f8b-6b66-4627-9955-287300d5191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f9428-4b53-4efa-9fb1-7acb7a25f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:26 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Volume volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 (9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5): created successfully
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f9428-4b53-4efa-9fb1-7acb7a25f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Flow 'volume_create_manager' (96bb8bf3-ef6b-489d-83f5-e05dade51f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.306s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:26 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-0aeaf0ce-f869-4ce3-b355-4c3aa67f2b8e tempest-SnapshotDependencyTests-1393468747 None] Created volume successfully.
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-9447e862-1fb9-4f9e-aacc-2ea1e47acb6f tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-d8185c04-2ee0-40cf-a9f2-5b70d46cc370-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:26 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:27 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" acquired by "delete_volume" :: waited 0.011s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a33b00-f0e0-494b-aad0-7a602f40c274]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:27 devstack quobyte-client[84528]: System call of process 103489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" returned: 0 in 0.671s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:27 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:28 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" returned: 0 in 0.379s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Creating offline snapshot 06f32618-e70a-4296-a6e8-f60de1bd41bc of volume 9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444b017-fc8c-49cd-8bb0-1d9ca9ce2f3c]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9" released by "delete_volume" :: held 1.304s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['b55b4636-31bc-4b37-a1cb-a877c6ccb7cf', 'f31475e4-a555-44e0-acbc-24e9f346bf55', 'ceefc587-a1aa-4883-8e4e-6fdfae4d7592', '90b99319-eaf4-4958-a7bf-467781e4bb4f'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.599s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:28 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:29 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=167, name=volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-a1de39ee-d21d-44f1-906d-8a3224de3d6c-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc 1G" returned: 0 in 0.580s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:29 devstack quobyte-client[84528]: System call of process 103499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:29 devstack quobyte-client[84528]: System call of process 103499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-a1de39ee-d21d-44f1-906d-8a3224de3d6c-delete_volume" acquired by "delete_volume" :: waited 0.370s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "qemu-img rebase -u -b volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.388s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:34:29 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.484s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.518s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:30 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.413s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:30 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:31 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "cinder-quobyte-a1de39ee-d21d-44f1-906d-8a3224de3d6c" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.info" returned: 0 in 0.318s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-acaac1a8-1c37-44e2-aa4e-eb41918122b5 tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-1bc6eaa0-5ca1-42d4-a802-59e88033dcb9-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-a1de39ee-d21d-44f1-906d-8a3224de3d6c" acquired by "delete_volume" :: waited 0.294s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0242e45-39bb-4308-98d3-d92faf2c11b1]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.info" returned: 0 in 0.318s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:31 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.521s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:31 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1d779130-096c-4206-b1a6-8598f2f96a6c tempest-SnapshotDependencyTests-1393468747 None] Create snapshot completed successfully
Sep 24 18:34:31 devstack quobyte-client[84528]: System call of process 103507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:31 devstack quobyte-client[84528]: System call of process 103507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:31 devstack quobyte-client[84528]: System call of process 103507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c" returned: 0 in 0.588s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-a1de39ee-d21d-44f1-906d-8a3224de3d6c" returned: 0 in 0.099s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-quobyte-a1de39ee-d21d-44f1-906d-8a3224de3d6c" released by "delete_volume" :: held 0.885s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Created reservations ['932c3e11-ec7b-430e-acbf-9f84edc738e0', '64579fc1-af04-40b3-abdd-61286e96eaae', '3b83d5ad-5939-4b88-b1e7-09395d54a8d3', '72f2f8f9-6ef5-4796-b635-c1d35e4e4d75'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:32 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:33 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.155s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:33 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:33 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Deleted volume successfully.
Sep 24 18:34:33 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-8059f913-5629-4a75-ab18-df21b93b5cae tempest-CreateVolumesFromSourceVolumeTest-1284495964 None] Lock "cinder-a1de39ee-d21d-44f1-906d-8a3224de3d6c-delete_volume" released by "delete_volume" :: held 3.688s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:34 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Flow 'volume_create_manager' (fde36807-9574-427f-86f7-3a646e78d7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ef8e63-fccc-433f-a8a3-a86d78554440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ef8e63-fccc-433f-a8a3-a86d78554440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff7a3b-7722-4bcc-b339-1ba26fd285e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a44ac29c50461d9403a79e6427c728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06f32618-e70a-4296-a6e8-f60de1bd41bc,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:34Z,use_quota=True,user_id='5e1816093bb0463a8a19dcecd31b842e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9d7fa-d5c8-40e1-b0c9-ca35d3ea3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd9d7fa-d5c8-40e1-b0c9-ca35d3ea3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4339b30f-5d3c-432b-bdf5-c5c254b7c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4339b30f-5d3c-432b-bdf5-c5c254b7c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41ff7a3b-7722-4bcc-b339-1ba26fd285e0', 'volume_name': 'volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0', 'volume_size': 1, 'snapshot_id': '06f32618-e70a-4296-a6e8-f60de1bd41bc'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0062025-0939-4613-b95e-ec81af6f940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0062025-0939-4613-b95e-ec81af6f940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632d034-6ce9-4215-b56c-1c5419b69d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:34 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Volume 41ff7a3b-7722-4bcc-b339-1ba26fd285e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0', 'volume_size': 1, 'snapshot_id': '06f32618-e70a-4296-a6e8-f60de1bd41bc'}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" by "_create_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Creating volume 41ff7a3b-7722-4bcc-b339-1ba26fd285e0 from snapshot 06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" by "_copy_volume_from_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] snapshot: 06f32618-e70a-4296-a6e8-f60de1bd41bc, volume: 41ff7a3b-7722-4bcc-b339-1ba26fd285e0,  {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5c4a53-ff82-4c86-9828-f2839280b758]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:34 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:35 devstack quobyte-client[84528]: System call of process 103513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:35 devstack quobyte-client[84528]: System call of process 103513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:35 devstack quobyte-client[84528]: System call of process 103513 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.615s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Creating direct copy from snapshot {{(pid=84502) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a92707a-8318-4b4c-bd14-7f114fa59efc]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:35 devstack quobyte-client[84528]: System call of process 103517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.501s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG cinder.utils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 not found in is_blk_device check {{(pid=84502) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:34:35 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:36 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=169, name=volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:39 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:39 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Flow 'volume_create_manager' (dd8cf15d-4924-4308-b94c-2ec748a3432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:39 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d22bde-d0f2-4166-a095-b37701751a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d22bde-d0f2-4166-a095-b37701751a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccd73ea-0fb2-4418-accb-90b08aa69bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0f24c0211148b4adb70899e475ecaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:39Z,use_quota=True,user_id='9ceaf70e5a7c4f3bb0aee1ee8819e0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a20c5d-15b5-4f3a-9616-8b0763e4a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a20c5d-15b5-4f3a-9616-8b0763e4a98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f088b-b588-4979-a608-5f00901a387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7f088b-b588-4979-a608-5f00901a387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccd73ea-0fb2-4418-accb-90b08aa69bb8', 'volume_name': 'volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1043871f-a136-448a-8514-5f4578060aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1043871f-a136-448a-8514-5f4578060aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c648b95c-e438-4199-a973-3a62412d04db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:40 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Volume 2ccd73ea-0fb2-4418-accb-90b08aa69bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8', 'volume_size': 1}
Sep 24 18:34:40 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" returned: 0 in 6.687s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:42 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef4ff1-b34d-47ef-a353-724fdb9ed9f8]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:42 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:43 devstack quobyte-client[84528]: System call of process 103532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:43 devstack quobyte-client[84528]: System call of process 103532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:43 devstack quobyte-client[84528]: System call of process 103532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.578s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.image.image_utils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Image conversion details: src /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 {{(pid=84502) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:34:43 devstack cinder-volume[84502]: INFO cinder.image.image_utils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Converted 1024.00 MB image at 152.99 MB/s
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" returned: 0 in 0.093s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" released by "_copy_volume_from_snapshot" :: held 8.918s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" released by "_create_volume_from_snapshot" :: held 8.982s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.362s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccd73ea-0fb2-4418-accb-90b08aa69bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0f24c0211148b4adb70899e475ecaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:39Z,use_quota=True,user_id='9ceaf70e5a7c4f3bb0aee1ee8819e0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Creating volume 2ccd73ea-0fb2-4418-accb-90b08aa69bb8 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:43 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:43 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:43 devstack quobyte-client[84528]: System call of process 103536 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:43 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=170, name=volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4632d034-6ce9-4215-b56c-1c5419b69d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0', 'volume_size': 1, 'snapshot_id': '06f32618-e70a-4296-a6e8-f60de1bd41bc'}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8b1a8e-fc68-4e73-8dfd-c4e84b749498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:44 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Volume volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 (41ff7a3b-7722-4bcc-b339-1ba26fd285e0): created successfully
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8b1a8e-fc68-4e73-8dfd-c4e84b749498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Flow 'volume_create_manager' (fde36807-9574-427f-86f7-3a646e78d7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 1073741824" returned: 0 in 0.603s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" returned: 0 in 0.301s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:44 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-cb8beb45-0ff3-48f7-9d98-c0e9afd2ebd8 tempest-SnapshotDependencyTests-1393468747 None] Created volume successfully.
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c648b95c-e438-4199-a973-3a62412d04db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ad8757-0f50-4ddf-923e-660ed3561bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-06f32618-e70a-4296-a6e8-f60de1bd41bc-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:44 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Volume volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 (2ccd73ea-0fb2-4418-accb-90b08aa69bb8): created successfully
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ad8757-0f50-4ddf-923e-660ed3561bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Flow 'volume_create_manager' (dd8cf15d-4924-4308-b94c-2ec748a3432d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-06f32618-e70a-4296-a6e8-f60de1bd41bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:44 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:44 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:45 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c44d9564-ecc4-4e15-94c6-313ab1be1e41 tempest-CinderUnicodeTest-1553818624 None] Created volume successfully.
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Deleting offline snapshot 06f32618-e70a-4296-a6e8-f60de1bd41bc of volume 9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] snapshot_file for this snap is: volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab31c39d-2bfa-47e4-8813-377acc5f0834]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.434s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2b2f0-b50b-4d81-acc8-fcacfdc3a352]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:45 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:45 devstack quobyte-client[84528]: System call of process 103544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.439s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:46 devstack quobyte-client[84528]: System call of process 103547 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.293s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5.06f32618-e70a-4296-a6e8-f60de1bd41bc" returned: 0 in 0.139s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-06f32618-e70a-4296-a6e8-f60de1bd41bc" released by "_delete_snapshot" :: held 1.903s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:46 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" released by "delete_snapshot" :: held 1.950s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:46 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84502) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Flow 'volume_create_manager' (359c5de4-e8b6-4129-9f05-b99a1f7ca981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cddcf7-56b1-49c1-8dfe-7a865da898bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cddcf7-56b1-49c1-8dfe-7a865da898bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-313272529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77908cb8-e43e-44c2-b0d7-68c6474899b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0f24c0211148b4adb70899e475ecaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:47Z,use_quota=True,user_id='9ceaf70e5a7c4f3bb0aee1ee8819e0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940f07ee-b02a-4c7f-8c5e-c78ba3afaea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940f07ee-b02a-4c7f-8c5e-c78ba3afaea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e649611-1b4a-4e1d-8117-d21c1163c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e649611-1b4a-4e1d-8117-d21c1163c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77908cb8-e43e-44c2-b0d7-68c6474899b6', 'volume_name': 'volume-77908cb8-e43e-44c2-b0d7-68c6474899b6', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e897c5-a29d-417d-bb29-3f82383949bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e897c5-a29d-417d-bb29-3f82383949bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847b8c41-94c4-4b84-8218-80d050f050ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:47 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Volume 77908cb8-e43e-44c2-b0d7-68c6474899b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77908cb8-e43e-44c2-b0d7-68c6474899b6', 'volume_size': 1}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f0b915f7eb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-313272529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77908cb8-e43e-44c2-b0d7-68c6474899b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0f24c0211148b4adb70899e475ecaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:47Z,use_quota=True,user_id='9ceaf70e5a7c4f3bb0aee1ee8819e0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb9152e0-dfc1-4baa-b0af-9cf425220637),volume_type_id=cb9152e0-dfc1-4baa-b0af-9cf425220637)}" {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Creating volume 77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Selected 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2 as target Quobyte volume. {{(pid=84502) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:47 devstack cinder-volume[84502]: INFO cinder.volume.drivers.remotefs [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] casted to 10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 1073741824 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:47 devstack quobyte-client[84528]: System call of process 103551 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:47 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=171, name=volume-77908cb8-e43e-44c2-b0d7-68c6474899b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 1073741824" returned: 0 in 0.468s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6" returned: 0 in 0.177s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] <== create_volume: return (698ms) {'provider_location': '10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'} {{(pid=84502) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:47 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Created reservations ['8173535f-892e-4668-9e65-d12486e5f26e', '4faf8b00-fdd9-4f66-a7a0-378c1d96f041', 'c82464e8-4ed5-4f1b-a612-9b6a813d1a5a', '1f41f3f1-14ad-42ef-8321-dd9033353261'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847b8c41-94c4-4b84-8218-80d050f050ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77908cb8-e43e-44c2-b0d7-68c6474899b6', 'volume_size': 1}' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe86c922-f2e8-470d-b0ca-7ea515729361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:48 devstack cinder-volume[84502]: INFO cinder.volume.flows.manager.create_volume [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Volume volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 (77908cb8-e43e-44c2-b0d7-68c6474899b6): created successfully
Sep 24 18:34:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe86c922-f2e8-470d-b0ca-7ea515729361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84502) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:48 devstack cinder-volume[84502]: DEBUG cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Flow 'volume_create_manager' (359c5de4-e8b6-4129-9f05-b99a1f7ca981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84502) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:48 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-4f016df6-3ebd-4225-916d-83e4d7b36fd3 tempest-CinderUnicodeTest-1553818624 None] Created volume successfully.
Sep 24 18:34:48 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Delete snapshot completed successfully.
Sep 24 18:34:48 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-6c59a897-12fb-4880-a128-815c7f9ddd36 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-06f32618-e70a-4296-a6e8-f60de1bd41bc-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Creating offline snapshot 2b23a7ab-8242-4284-af6a-a8011921e93e of volume 77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1d0f8-3fda-4032-9c0f-96a790826d0e]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:49 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" acquired by "delete_volume" :: waited 0.109s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[026712e5-3b41-4804-9170-5d1674238f82]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:49 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:49 devstack quobyte-client[84528]: System call of process 103555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:49 devstack quobyte-client[84528]: System call of process 103555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6" returned: 0 in 0.630s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e 1G {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:50 devstack quobyte-client[84528]: System call of process 103559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:50 devstack quobyte-client[84528]: The server volume:fb1a4dd2-d3e0-42e2-9298-fa1a55536627@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=fb1a4dd2-d3e0-42e2-9298-fa1a55536627, inode=172, name=volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.72), requestorAccessMask=0
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.595s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e 1G" returned: 0 in 0.493s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): qemu-img rebase -u -b volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" returned: 0 in 0.223s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5" released by "delete_volume" :: held 1.271s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:50 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "qemu-img rebase -u -b volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 -F qcow2 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.410s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.278s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Setting permissions: /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 -> 1000:1000 {{(pid=84502) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.310s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.info" returned: 0 in 0.182s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] File path /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.info is being set with permissions: 660 {{(pid=84502) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.info {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:51 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Created reservations ['bdf58e0c-9788-468f-9354-711cb6b66306', '7948d838-01d1-402c-ac98-cf1d980436ac', '62709675-2f98-4fb6-879d-293abc4cb4d0', '8feda1a6-2c86-4084-9283-233154aa0244'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.info" returned: 0 in 0.284s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.868s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-1db41085-5a71-4672-b5eb-fdd4e802b7c0 tempest-CinderUnicodeTest-1553818624 None] Create snapshot completed successfully
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.095s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:52 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Deleted volume successfully.
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-41ff7a3b-7722-4bcc-b339-1ba26fd285e0-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-41ff7a3b-7722-4bcc-b339-1ba26fd285e0-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:52 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-ec0613a0-afc1-4be6-87a1-8d626b2ebda0 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-9f912f2e-6aea-4f8e-ad51-a6a0392f2cd5-delete_volume" released by "delete_volume" :: held 3.658s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" acquired by "delete_volume" :: waited 0.013s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[491572a5-308d-429c-94b7-4cae1a79ba92]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:53 devstack quobyte-client[84528]: System call of process 103573 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-2b23a7ab-8242-4284-af6a-a8011921e93e-delete_snapshot" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" returned: 0 in 0.581s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-2b23a7ab-8242-4284-af6a-a8011921e93e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.233s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:53 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" by "delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:53 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" returned: 0 in 0.262s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-quobyte-41ff7a3b-7722-4bcc-b339-1ba26fd285e0" released by "delete_volume" :: held 0.932s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" acquired by "delete_snapshot" :: waited 0.209s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-quobyte-2b23a7ab-8242-4284-af6a-a8011921e93e" by "_delete_snapshot" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-2b23a7ab-8242-4284-af6a-a8011921e93e" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Deleting offline snapshot 2b23a7ab-8242-4284-af6a-a8011921e93e of volume 77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] snapshot_file for this snap is: volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89b223a-e115-483c-bdf5-b16138ce1158]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Created reservations ['dc05dc5f-4a9a-4603-b107-ae6f9e0eec29', '687f14d8-64c0-446c-9c88-abd4371beb90', 'cb2a182d-05b1-4c3f-8085-2d7f5c8e29d2', '363e9827-e826-43b9-bb74-37206bd2e100'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:54 devstack quobyte-client[84528]: System call of process 103578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:54 devstack quobyte-client[84528]: System call of process 103578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.571s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.remotefs [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77908cb8-e43e-44c2-b0d7-68c6474899b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84502) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc540ff-3d47-4c55-abd9-6dcf1cde4a50]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:54 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.144s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:55 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Deleted volume successfully.
Sep 24 18:34:55 devstack quobyte-client[84528]: System call of process 103581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:55 devstack quobyte-client[84528]: System call of process 103581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-26e74834-3b90-475b-a52d-76d673ef51b2 tempest-SnapshotDependencyTests-1393468747 None] Lock "cinder-41ff7a3b-7722-4bcc-b339-1ba26fd285e0-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6" returned: 0 in 0.886s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:55 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.283s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6.2b23a7ab-8242-4284-af6a-a8011921e93e" returned: 0 in 0.118s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-2b23a7ab-8242-4284-af6a-a8011921e93e" released by "_delete_snapshot" :: held 2.167s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" released by "delete_snapshot" :: held 2.271s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:56 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Created reservations ['c10fab04-de1a-4c63-977a-3cc66fd76c96', '1809e5b7-f4a8-440d-899f-86e0ccfae68e', 'd2103c3d-952b-47f3-93d3-069fff128ad1', 'f58a3b0c-43c8-408c-bcf6-f0c9d733f1ae'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:57 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Delete snapshot completed successfully.
Sep 24 18:34:57 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-c8f0b522-7470-4dfb-b984-b9230b899bce tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-2b23a7ab-8242-4284-af6a-a8011921e93e-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-77908cb8-e43e-44c2-b0d7-68c6474899b6-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-77908cb8-e43e-44c2-b0d7-68c6474899b6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:58 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" acquired by "delete_volume" :: waited 0.023s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de707a2-8546-4f1e-805b-4485223a22f6]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:58 devstack quobyte-client[84528]: System call of process 103624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6" returned: 0 in 0.442s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:58 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-77908cb8-e43e-44c2-b0d7-68c6474899b6" returned: 0 in 0.120s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-77908cb8-e43e-44c2-b0d7-68c6474899b6" released by "delete_volume" :: held 0.828s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Created reservations ['87368a9b-9682-4fe2-931e-1a1dfbe4a0d8', '3ab7e7c2-96d1-477a-bbf9-4825ca1ed815', '570eac05-4fe1-4273-b42a-c5a2a675aa43', 'e8618056-c932-4a77-aec9-0e059f5a2a10'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.150s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:59 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:00 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Deleted volume successfully.
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-e66015cb-faa5-49ee-b4eb-0b42e2f6d7ff tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-77908cb8-e43e-44c2-b0d7-68c6474899b6-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-2ccd73ea-0fb2-4418-accb-90b08aa69bb8-delete_volume" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-2ccd73ea-0fb2-4418-accb-90b08aa69bb8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:00 devstack cinder-volume[84502]: WARNING cinder.volume.volume_utils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "cinder-quobyte-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" by "delete_volume" {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" acquired by "delete_volume" :: waited 0.022s {{(pid=84502) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ec68f-c9fa-4904-b7a2-2646c710ee8d]: (4, 'qcow2') {{(pid=85879) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:00 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:01 devstack quobyte-client[84528]: System call of process 103629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:01 devstack quobyte-client[84528]: System call of process 103629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:01 devstack quobyte-client[84528]: System call of process 103629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" returned: 0 in 0.569s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:01 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] CMD "rm -f /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9/volume-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" returned: 0 in 0.155s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:01 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-quobyte-2ccd73ea-0fb2-4418-accb-90b08aa69bb8" released by "delete_volume" :: held 0.944s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG cinder.quota [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Created reservations ['f0abd6ba-b498-4731-965a-b51e02cf8fad', 'b5205342-2793-404d-8f63-4b9da35d0f4e', 'b4569807-6f8c-4d59-b0ef-ce20df1c5377', '4fd4e296-5199-468f-8a6c-dff02445e6f3'] {{(pid=84502) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.124s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:02 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:02 devstack cinder-volume[84502]: INFO cinder.volume.manager [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Deleted volume successfully.
Sep 24 18:35:03 devstack cinder-volume[84502]: DEBUG cinder.coordination [None req-f5acad1c-06cf-4aa2-ae44-9db70de41077 tempest-CinderUnicodeTest-1553818624 None] Lock "cinder-2ccd73ea-0fb2-4418-accb-90b08aa69bb8-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=84502) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:12 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:SELECT=81,cinder:UPDATE=107,cinder:DELETE=8,cinder:INSERT=28 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:35:12 devstack cinder-volume[84502]: DEBUG dbcounter [-] [84502] Writing DB stats cinder:UPDATE=119,cinder:DELETE=14,cinder:SELECT=66,cinder:INSERT=20 {{(pid=84502) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_service.periodic_task [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84502) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2': None} {{(pid=84502) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG cinder.volume.drivers.quobyte [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Available shares ['10.10.41.181/cinder-vol-286be0da-216b-4414-a055-fac69d4171d2'] {{(pid=84502) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.lockutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84502) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9 {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG oslo_concurrency.processutils [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/bfcbd1dd11d10c0ea1fdea51277d56b9" returned: 0 in 0.090s {{(pid=84502) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:17 devstack cinder-volume[84502]: DEBUG cinder.manager [None req-1f258d8f-db91-41c9-80bd-27ed46ac2d17 None None] Notifying Schedulers of capabilities ... {{(pid=84502) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}